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An  anthropomorphic  bipedal  locomotion  system  is  studied  to  investigate 
the  system’s  robustness  and  susceptibility  to  loss  of  stability  in  the  face  of  large 
magnitude  disturbances  such  as  slipping  and  tripping.  The  study  is  performed  via 
mathematical  simulation  of  a planar  five-link  biped  model  and  closed-loop  control 
system. 

The  equations  of  motion  are  formulated  using  the  Euler-Lagrange 
differential  equation  and  the  Denavit-Hartenberg  coordinate  frame 
representation.  The  equations  of  impact  are  derived  using  the  principles  of  linear 
and  angular  impulse  and  momentum.  The  equations  are  formulated  and 
simulated  to  correctly  model  surface  friction  effects  and  slipping. 

A nominal  control  system  is  formulated  to  accommodate  all  phases  of 
locomotion  including  standing,  starting,  progression,  and  stopping.  The  biped  is 
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capable  of  progression  over  various  surface  grades  with  variable  step  length  and 
progression  velocity.  Joint  trajectory  tracking  is  performed  using  the  robust 
feedback  linearization  technique  known  as  sliding  mode  control.  Sub-optimal  gait 
synthesis  parameters  are  determined  as  the  basis  of  an  on-line  gait  optimization 
algorithm. 

The  basic  capabilities  of  the  nominally  controlled  bipedal  locomotion 
system  are  demonstrated  with  simulation  results.  The  susceptibility  of  the  system 
to  loss  of  stability  after  slipping  and  tripping  is  demonstrated. 

A reflexive  control  algorithm  is  developed  and  integrated  into  the  nominal 
control  structure.  The  reflexive  control  successfully  rejects  the  large  magnitude 
disturbances  of  slipping  and  tripping.  The  performance  of  the  reflexive  control 
algorithm  is  demonstrated  and  the  improvement  in  robustness  of  the  locomotion 
system  is  quantified. 
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CHAPTER  1 
INTRODUCTION 

1.1  Motivation 

Why  legged  locomotion?  Most  terrestrial  locomotion  systems  employ 
wheels.  Wheels  provide  an  unparalleled  level  of  mechanical  efficiency  when 
traversing  smooth  terrain.  Unfortunately,  very  little  of  earth’s  terrain  is  smooth. 
When  the  terrain  is  not  smooth  wheeled  locomotion  systems  lose  their 
advantage,  and  when  it  is  very  rough  they  cannot  move  at  all.  On  these  rough 
surfaces  legged  locomotion  systems  prevail  because  foot  placement  can  be 
selected  to  avoid  obstacles  and  optimize  support  and  traction.  For  proof  of  the 
superiority  of  legged  locomotion,  consider  that  a mountain  goat  is  capable  of 
negotiating  extremely  steep  and  rough  terrain  with  astounding  speed.  Consider 
also  that  human  beings  regularly  climb  steep  stairs  and  ladders  which  represent 
insurmountable  obstacles  to  non-legged  locomotion  systems. 

Why  bipedal  locomotion?  Humans  are  unique  in  their  form  of  legged 
locomotion.  This  uniqueness  has  led  to  the  development  of  environments 
specifically  tailored  to  our  bipedal  method  of  locomotion.  One  primary  goal  of  our 
research  into  legged  locomotion  is  the  development  of  systems  capable  of 
replacing  human  beings  in  hazardous  environments  such  as  nuclear  power 
plants  or  burning  buildings.  Unlike  most  non-legged  or  multiple-legged 
locomotion  systems,  a bipedal  robot  can  move  rapidly  along  a narrow  path 
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where  a broad  base  of  support  is  not  available.  Bipedal  locomotion  systems  are 
best  suited  to  spaces  originally  designed  for  humans. 

Why  anthropomorphic  bipedal  locomotion?  There  are  good  reasons  why  a 
bipedal  locomotion  system  should  be  anthropomorphic. 

• Bipeds  that  function  in  a fashion  kinematically  similar  to  human  beings  will 
encounter  fewer  un-anticipated  obstacles  when  operating  in  made-for- 
human  environments 

• The  human  locomotion  system  is  worthy  of  emulation.  Human  beings 
have  been  optimized  by  millions  of  years  of  natural  selection,  an 
optimization  process  that  should  not  be  discounted 

• There  is  much  we  do  not  understand  about  the  way  humans  perform  the 
complicated  feat  of  dynamically  stable  locomotion.  Greater  understanding 
of  the  control  mechanisms  involved  in  human  locomotion  has  the  potential 
to  improve  the  analysis  of  degenerate  human  gait,  help  predict  the  results 
of  surgery  or  therapy,  and  improve  the  design  of  endo-prosthetic  devices. 

1.2  Background 

Research  has  been  conducted  in  the  area  of  legged  locomotion  for  nearly 
40  years,  yet  the  past  decade  has  seen  an  explosion  of  interest  in  the  field.  This 
surge  of  activity  is  most  likely  attributable  to  the  recent  maturation  of  nonlinear 
analysis,  control,  and  modeling  tools  and  techniques.  Within  the  engineering 
community,  the  primary  focus  of  this  research  is  the  creation  of  dynamically 
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stable,  autonomous,  and  robust  bipedal  locomotion  robots.  The  vast  majority  of 
the  research  effort  to  date  can  be  separated  into  the  following  categories: 

• High-level  Planning 

• Gait  Synthesis 

• Tracking  Control 

These  topics  represent  the  primary  control  elements  necessary  to  realize  a 
bipedal  locomotion  robot.  Figure  1.1  shows  an  overview  of  a bipedal  locomotion 
system  in  block  diagram  form.  The  diagram  distinguishes  between  the  ‘control’ 
consisting  of  the  primary  elements  previously  mentioned,  and  the  ‘plant’ 
consisting  of  the  system  to  be  controlled.  This  overview  is  generally  adopted  in 
the  literature. 


Figure  1.1  - Overview  of  Bipedal  Locomotion  System 


4 


1.2.1  High-level  Planning 

A necessary  part  of  any  successful  autonomous  mobile  robot  is  high-level 
planning.  Figure  1.1  shows  the  output  of  the  high-level  planning  task  is  a series 
of  gait  parameters  that  are  passed  directly  to  the  gait  synthesis  module.  High- 
level  planning  includes: 

• High-level  sensor  incorporation:  Determination  of  obstacle  location, 
surface  characteristics,  and  available  footholds. 

• Path  planning:  Global  point-to-point  path  solution  with  obstacle  avoidance. 

• Gait  parameter  selection:  Selection  of  biped  attitude  and  gait  control 
parameters  to  avoid  obstacles  and  optimize  support  and  traction.  Gait 
parameters  may  include  such  things  as  locomotion  phase,  step  length,  and 
step  height. 

High-level  planning  has  received  relatively  little  attention  in  the  bipedal 
locomotion  literature  to  date.  Very  often  it  is  lumped  with  the  gait  synthesis  task 
or  the  high-level  parameters  are  assumed  input  to  the  system  from  a remote 
operator.  The  subject  of  path  planning  in  the  realm  of  non-legged  locomotion 
robots  has  received  considerable  attention  [1-3].  For  a survey  of  mobile  robot 
navigation  techniques  see  Stormont  et  al.  [4].  Much  of  the  navigation  and  path 
planning  work  is  directly  applicable  to  this  aspect  of  legged  locomotion  systems. 

There  has  been  some  successful  research  in  the  area  of  sensor 
incorporation  into  bipedal  locomotion  systems.  Kajita  and  Tani  [5]  used  an 
ultrasonic  range  sensor  to  allow  a 6-degree  of  freedom  robot  to  walk  over  ground 
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of  unknown  profile.  Several  researchers  have  included  force  and/or  slope 
sensors  into  the  robot  feet  to  facilitate  negotiation  of  uneven  ground  profiles  [6- 
8].  Inaba  et  al.  [9]  incorporated  a vision  system  which  is  used  to  balance  a three- 
dimensional  biped  robot. 

1.2.2  Gait  Synthesis 

The  second  necessary  control  element  is  gait  synthesis.  The  gait 
synthesis  task  is  defined  to  be  the  creation  of  realizable  joint  trajectories  that,  if 
adequately  tracked,  will  achieve  the  desired  phase  of  locomotion.  Figure  1.1 
shows  the  outputs  of  the  gait  synthesis  function  are  the  desired  joint  trajectories 
and  their  derivatives.  A completely  successful  gait  synthesis  algorithm  is  flexible 
enough  to  allow  a variety  of  step  lengths  and  speeds,  starting  and  stopping  at 
arbitrary  times,  walking  on  various  surfaces,  and  on  various  slopes.  The  problem 
of  bipedal  gait  synthesis  has  evoked  a number  of  distinct  solution  approaches 
from  the  research  community. 

One  approach  to  bipedal  gait  synthesis  is  to  simply  capture  the  gait 
pattern  of  human  subjects  in  the  laboratory  via  appropriate  measurements  [10- 
14].  The  measured  joint  trajectories  are  stored  in  memory  and  thereby  available 
for  selection  by  the  control  system  when  appropriate  to  task  and  terrain. 

Another  approach  to  gait  synthesis  involves  modeling  the  motion  of  the 
biped  using  a simple  geometric  function.  This  simple  function  is  then  adjusted  via 
optimization  techniques  to  minimize  some  cost  function,  typically  energy  or 
control  power.  This  approach  has  been  applied  almost  exclusively  to  the  single 
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support  or  progression  phase.  Typically  the  motion  of  the  hip  and  the  swing  foot 
are  modeled  using  Fourier  series’  or  polynomials  and  then  combined  with  the 
kinematic  constraints  to  determine  the  motion.  The  coefficients  of  the  geometric 
function  are  then  adjusted  to  minimize  a cost  function  over  a single  step  [15-18]. 
Channon  et  al.  [19]  employed  Lagrange  multipliers  to  convert  the  constrained 
optimization  problem  into  an  equivalent  two-point  boundary  value  problem. 

A vast  majority  of  the  gait  synthesis  research  has  focused  on  the 
progression  phase.  A few  researchers  have  focused  on  the  double  support  or 
standing  phase  of  locomotion.  Igarashi  and  Nogai  [20]  developed  the  closed- 
chain  equations  of  motion  and  applied  them  to  the  study  of  a six-element  walking 
robot.  Shih  and  Gruver  [21]  developed  a reduced  order  model  of  their  12-degree 
of  freedom  robot  in  the  double  support  phase.  There  has  been  some  research 
into  transition  locomotion  phases.  Reisinger  [22]  investigated  several  gait 
patterns  for  the  standing/balance  and  transition  phases  of  locomotion  and 
demonstrated  successful  patterns  in  each.  Baily  [23]  used  a ground  speed 
matching  algorithm  to  synthesize  gait  patterns  in  the  transition  phase  between 
standing  and  progression. 

Regardless  of  the  method  by  which  it  is  obtained,  pre-computed  and 
stored  gait  information  requires  a great  deal  of  computer  memory.  A limited 
number  of  gait  patterns  could  be  stored  requiring  some  interpolation  or 
extrapolation  based  on  desired  speed,  step  length,  surface  type/grade.  Memory 
requirements  are  large  for  the  number  of  gaits  necessary  to  reasonably 
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approximate  a modest  operating  regime.  To  address  this  shortcoming 
researchers  have  turned  to  on-line  gait  synthesis. 

A great  amount  of  research  has  focused  on  the  use  of  neural  network 
learning  for  on-line  gait  modification.  This  approach  makes  possible  the  learning 
of  new  gaits  that  are  more  than  weighted  combinations  of  pre-defined  gaits  [24- 
35].  Miller  [36]  applied  Cerebellar  Model  Arithmetic  Computer  (CMAC)  neural 
networks  to  synthesize  gait  for  a ten  degree  of  freedom  robot  without  the  use  of 
detailed  dynamic  models.  Neural  networks  have  been  shown  to  possess 
reasonably  good  approximation  characteristics.  This  would  imply  the  gait 
algorithm  would  be  robust  to  changes  in  the  robot  and  environment  parameters. 

While  model  free  gait  synthesis  is  attractive,  the  neural  network 
implementation  of  gait  synthesis  is  often  cumbersome  and  complex.  Neural 
network  implementations  require  a separate  network  for  each  phase  of  the 
locomotion  adding  to  the  complexity.  The  resulting  neural  network  gait  synthesis 
algorithm  is  not  at  all  transparent  and  does  not  readily  lend  itself  to  the  inclusion 
of  reflexes. 

A natural  approach  to  on-line  gait  synthesis  is  to  cast  the  high-level 
objective  and  the  kinematic  constraints  into  a number  of  physically  coherent  gait 
parameters.  These  gait  parameters  are  selected  by  the  high-level  planning 
algorithm  and  the  resulting  equations  are  solved  on-line.  Hurmuziu  [37] 
characterized  the  motion  of  a five-link  planar  biped  in  terms  of  progression 
speed,  step  length,  maximum  step  height,  and  stance  knee  bias. 
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1.2.3  Tracking  Control 

The  final  necessary  control  element  is  the  tracking  control.  This  task  is 
one  of  closed  loop  tracking  of  the  set  of  desired  joint  trajectories  while 
maintaining  overall  system  stability.  The  assumption  here  is  that  the  desired  joint 
trajectories  have  been  determined  (gait  synthesis)  and  are  available  as  input  to 
the  control.  Control  is  a challenging  task  in  the  development  of  a bipedal 
locomotion  system  for  the  following  reasons: 

• The  system  is  inherently  unstable  and  therefore  sensitive  to  control  error. 

• The  system  dynamics  are  extremely  nonlinear  and  difficult  to  model 

accurately. 

• Non-linearity  increases  with  increasing  system  velocity. 

1. 2.3.1  Linear  and  non-linear  control 

Many  algorithms  have  been  developed  for  the  control  of  bipedal 
locomotion  systems  using  traditional  linear  control  techniques.  These  traditional 
methods  have  achieved  success  under  certain  conditions.  Raibert  [38] 
developed  very  simple  algorithms  to  decouple  body  attitude,  body  height,  and 
foot  placement  of  a biped  system.  Miura  and  Shimoyama  [39]  used  inverted 
pendulum  dynamics  and  linearized  equations  of  motion  to  control  a seven 
degree  of  freedom  robot.  Channon  et  al.  [40]  used  optimal  state  feedback  to 
control  an  n-legged  robot  in  three  dimensions.  Furusho  and  Sano  [13] 
successfully  used  independent  linear  control  models  for  the  sagittal  and  lateral 
planes  of  a biped  system. 
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Linear  control  techniques  are  only  adequate  in  confined  operating  reginnes 
near  the  linearization  point  and  become  ineffective  when  joint  velocities  become 
even  moderately  high.  This  breakdown  is  due  to  the  inherent  nonlinear  nature  of 
the  system.  Some  simple  nonlinear  control  techniques  have  greatly  improved 
biped  performance  particularly  when  system  velocity  is  large.  Computed  torque 
control  is  a model  based  feedback  linearization  technique  applied  to  the  closed 
loop  tracking  of  the  requested  joint  trajectories.  The  technique  makes  use  of  a 
control  law  structure  similar  to  that  of  the  systems  dynamic  model  and  attempts 
to  eliminate  the  existing  nonlinearities  due  to  centripetal,  Coriolis,  and 
gravitational  forces.  The  technique  is  often  coupled  with  a simple  linear  control 
law,  typically  proportional  plus  derivative. 

Although  model  based  control  theory  applied  to  the  bipedal  locomotion 
problem  has  met  with  some  success,  its  effectiveness  is  diminished  with 
incomplete  knowledge  of  the  plant  and  environment.  The  principle  problems 
being  biped  parameter  uncertainty  (mass,  inertia,  friction,  orientation)  and  model 
complexity.  The  model  uncertainty  leads  to  a situation  where  the  computed 
torque  control  with  a linear  control  law  may  prove  inadequate. 

To  address  these  problems  a great  number  of  techniques  have  been 
proposed.  These  techniques  can  be  divided  into  two  main  categories: 

• Robust  control. 

• Adaptive  control. 

Robust  control  techniques  attempt  to  de-sensitize  the  control  to  variations 
(uncertainty)  in  the  system  parameters.  Adaptive  control  techniques  take  the 
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approach  of  learning  the  inverse  dynamics  of  the  system.  Essentially,  this 
amounts  to  on-line  tuning  of  model  parameters  to  match  the  system  response 
then  using  the  tuned  parameters  in  a model  based  control  algorithm.  We  will  now 
discuss  efforts  in  each  of  these  categories. 

1. 2.3.2  Robust  and  adaptive  control 

One  common  robust  control  design  technique  that  has  been  applied  to 
bipedal  locomotion  is  that  of  Variable  Structure  Control  (VSC)  or  Sliding  Mode 
Control.  VSC  schemes  are  by  design  robust  to  disturbances  and  parameter 
uncertainties.  Developing  a VSC  algorithm  requires  the  selection  of  a set  of 
switching  surfaces  and  a discontinuous  control  law  that  will  ensure  the 
attractiveness  of  the  system  trajectories  to  these  surfaces.  Once  the  system 
trajectories  are  on  the  switching  surfaces,  the  system  becomes  insensitive  to 
disturbances  and  parameter  variations.  Chang  and  Hurmuziu  [41]  developed  a 
VSC  algorithm  for  a planar  five-link  biped  model.  Their  formulation  of  the  sliding 
mode  equations  completely  eliminates  the  reaching  phase  by  defining  the  sliding 
domain  to  include  the  initial  state  of  the  system.  Tzafestas  et  al.  [42]  developed  a 
sliding  mode  algorithm  to  control  a human  sized  planar  five-link  biped  model. 

Fuzzy  logic  control  is  a technique  that  has  been  used  to  improve 
robustness  of  bipedal  locomotion  control  systems.  Fuzzy  logic  control  is  a model- 
free  compensation  in  that  it  creates  a nonlinear  control  response  surface  without 
the  use  of  an  internal  system  model.  The  nonlinear  control  compensation  is 
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purely  a function  of  joint  position  and  velocity  errors.  The  technique  has  been 
used  successfully  in  a number  of  studies  [43,  44], 

Another  technique  that  has  been  used  to  improve  robustness  of  legged 
locomotion  control  algorithms  is  the  incorporation  of  feed  forward  effector 
commands  that  mimic  human  reflexes.  Reflexes  have  been  used  in  response  to 
significant  discrete  events  such  as  stumbling  or  slipping.  Reflexes  have  been 
used  successfully  in  a number  of  legged  locomotion  system  applications.  Brooks 
[45]  used  simple  reflex-like  actions  in  combination  to  control  a hexapod  robot. 
Hirose  [46]  used  a reflexive  probing  action  to  navigate  a statically  stable 
quadruped  up  and  down  stairs  without  a priori  knowledge  of  the  terrain.  Wong 
and  Orin  [47]  implemented  two  reflexive  responses  in  the  control  system  of  a 
prototype  leg  of  the  Adaptive  Suspension  Vehicle.  Reflexes  were  used  to  reduce 
peak  forces  at  foot  touchdown  and  to  halt  slipping  when  detected.  Boone  and 
Hodgins  [48]  studied  the  inclusion  of  slipping  and  tripping  reflexes  into  the  control 
algorithm  of  a three  dimensional  hopping  robot  which  consists  of  a body  and  two 
telescoping  legs.  Their  responses  to  slipping  included  an  increase  in  the  vertical 
component  of  the  ground  reaction  force  by  increasing  hip  torque  or  extending  the 
rest  length  of  the  telescoping  leg.  Alternatively  adjustments  were  made  to  the 
gait  pattern  such  that  the  subsequent  step  would  position  the  foot  directly  under 
the  body  thereby  minimizing  the  risk  of  slipping  again.  These  reflexive  responses 
successfully  improved  the  robustness  of  the  hopping  biped.  The  use  of  reflexive 
response  in  robotic  systems  is  not  limited  to  locomotion  robots.  Manipulation 
robotics  systems  have  successfully  implemented  reflexes  in  a number  of 
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applications.  Wu  et  al.  [49]  use  a neuromuscular-like  control  including  a reflex 
which  demonstrates  compliance  in  performing  free  to  constrained  movement 
without  the  use  of  external  force  sensors.  Weng  and  Young  [50]  use  human-like 
reflexes  in  an  impact  control  for  robot  manipulators. 

Adaptive  control  techniques  applied  to  biped  systems  have  predominately 
taken  the  form  of  artificial  neural  networks  to  provide  on-line  learning  of  the 
inverse  system  dynamics  and/or  real-time  control  parameter  adjustment  [24,  27, 
36].  Some  researcher  have  used  Neuro-Fuzzy  control  techniques  to  provide  the 
adaptation  capability  of  neural  networks  while  allowing  the  incorporation  of 
empirical  or  heuristic  control  information  [26,  51,  52]. 


CHAPTER  2 

PROBLEM  IDENTIFICATION 

2.1  Analysis  of  Need 

Bipedal  locomotion  research  has  focused  on  the  gait  synthesis  and 
tracking  control  aspects  of  the  problem.  Within  the  control  function  very  good 
techniques  have  been  developed  to  account  for  system  non-linearity  and  to 
improve  the  robustness  of  the  control  system  to  model  uncertainty  and  small 
disturbances.  Very  little  research  has  been  devoted  to  large  disturbance  rejection 
such  as  recovery  from  slipping  or  tripping.  Any  bipedal  locomotion  system 
performing  a task  will  likely  be  subjected  to  such  large  magnitude  disturbances. 

In  order  to  be  viable,  the  bipedal  locomotion  system  will  require  the  ability  to 
detect  and  recover  from  such  disturbances.  Identifying  control  strategies  for 
recovery  from  large  magnitude  disturbances  is  necessary  for  the  success  of  an 
autonomous  bipedal  locomotion  robot. 

2.2  Problem  Statement 

We  propose  to  investigate  bipedal  locomotion  control  strategies  for 
recovery  from  large  magnitude  disturbances  such  as  slipping  and  tripping  by 
answering  the  following  questions.  What  sensor  information  can  be  used  to 
identify  a large  magnitude  disturbance?  What  immediate  control  action  should  be 
taken  to  maintain  system  stability  in  the  wake  of  a large-scale  disturbance  for  the 
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given  phase  of  locomotion  and  type  of  disturbance?  What  threshold(s)  will  be 
used  to  avoid  false  detection  and  unnecessary  control  effort?  How  and/or  will  the 
control  action  be  scaled  with  the  magnitude  of  the  disturbance?  What 
subsequent  action  must  be  taken  to  recover  the  original  desired  gait?  How  can 
these  reflexive  responses  be  incorporated  smoothly  into  an  existing  control 
hierarchy? 


2.3  Hypothesis  and  Justification 

We  hypothesize  that  the  incorporation  of  appropriate  human-like  reflexes 
and  post-reflex  gait  adjustments  will  allow  a bipedal  locomotion  system  to 
successfully  recover  from  large  magnitude  disturbances  such  as  slipping,  and 
tripping  during  the  locomotion  process.  We  define  disturbance  recovery  to 
consist  of  the  reflexive  response  followed  by  a post-reflex  gait  adjustment.  The 
reflexive  response  is  defined  to  be  a quick  response  to  sensory  input  requiring 
little  or  no  explicit  modeling.  The  post-reflex  gait  adjustment  consists  of  the 
modifications  of  the  gait  parameters  necessary  to  resume  the  desired  gait.  The 
post-reflex  adjustments  are  necessarily  slower  and  may  involve  explicit 
modeling. 

Biological  systems  use  reflexes  in  response  to  specific  stimuli  in  all 
phases  of  locomotion  and  manipulation.  It  follows  that  reflexes  may  be  used  to 
advantage  in  man  made  robotic  systems  attempting  to  accomplish  similar  tasks. 

Reflexes  have  been  used  successfully  in  a broad  range  of  robotics 
applications  including  manipulation  robotics  and  legged-locomotion  systems.  As 
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previously  highlighted,  Boone  and  Hodgins  [48]  successfully  included  slipping 
and  tripping  reflexes  into  the  control  algorithm  of  their  hopping  biped.  The  work 
of  Boone  and  Hodgins  is  not  directly  applicable  to  an  anthropomorphic  biped  that 
does  not  hop,  possess  telescoping  legs,  or  store  energy  in  springs.  The 
anthropomorphic  biped  possesses  significantly  more  coupling  than  is  present  in 
the  hopping  biped.  This  coupling  requires  a level  of  limb  coordination  that  is  not 
required  by  the  hopping  biped.  It  is  clear  the  results  of  Boone  and  Hodgins  are 
not  applicable  to  an  anthropomorphic  biped. 


CHAPTER  3 

SYSTEM  DESCRIPTION 


3.1  System  Overview 

The  focus  of  this  research  is  the  investigation  of  the  effects  of  slipping  and 
tripping  on  the  stability  of  a bipedal  locomotion  robot.  It  is  our  intention  to  use 
mathematical  simulation  of  a bipedal  locomotion  system  to  develop  a control 
algorithm  that  is  more  robust  to  large  magnitude  disturbances  such  as  slipping 
and  tripping.  A mathematical  model  of  the  system  to  be  controlled  (plant)  is 
therefore  required.  The  primary  elements  of  the  bipedal  locomotion  system  are 
shown  in  Figure  1.1  and  listed  below: 

• Planar  biped 

• Joint  actuators  and  sensors 

• Environment  in  which  the  biped  will  operate. 

Throughout  this  research  we  have  chosen  to  restrict  our  analysis  to  the  sagittal 
plane.  We  therefore  proceed  with  the  two-dimensional  model  development. 

3.2  Planar  Biped  Model 

Figure  3.1  represents  the  five-link  planar  biped  that  has  been  modeled  for 
the  purpose  of  this  research.  It  consists  of  a torso  (link  5)  and  two  legs  each  with 
an  upper  segment  (links  4 & 6)  and  a lower  segment  (links  3 & 7).  Four 
independently  actuated  revolute  joints  connect  the  links.  These  joints  are 
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Figure  3.1  - Planar  Five-Link  Biped 

considered  to  be  friction  free.  It  is  assumed  that  the  motion  of  the  biped  is 
constrained  to  the  sagittal  plane.  Although  feet  are  neglected  and  point  contact  is 
assumed,  we  allow  moments  at  the  ankles.  The  contact  point  ‘b’  (base)  refers  to 
the  tip  of  the  support  leg  while  the  contact  point  ‘f  (free)  refers  to  the  tip  of  the 
swing  leg. 

Due  to  the  nature  of  our  study  it  is  necessary  to  develop  a model  which 
will  be  valid  in  all  phases  of  the  locomotion  process  including  single  support, 
double  support,  single  impact,  and  double  impact.  In  all  of  these  primary  phases 
it  is  necessary  to  model  both  slip  and  no-slip  conditions  which  will  depend  on 
surface  friction  forces. 

The  single  support  phase  may  be  modeled  as  a fixed  base  serial 
manipulator  since  the  five-link  planar  biped  forms  a serially  actuated  simple 
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kinematic  chain.  However,  the  fixed  base  assumption  creates  a problem  when 
attempting  to  model  foot  slippage.  Additionally,  the  fixed  base  single  support 
model  cannot  be  used  to  correctly  model  the  impact  phase  since  at  the  moment 
of  impact  (heel  strike)  the  supporting  leg  tip  velocities  must  be  free  to  change.  A 
simple  solution  to  both  of  these  problems  is  the  incorporation  of  the  support  leg 
tip  coordinates  into  the  equations  of  motion.  These  two  additional  degrees  of 
freedom  correctly  model  the  impact  phase  as  well  as  providing  the  capability  to 
handle  slipping.  Their  inclusion  requires  the  calculation  of  the  corresponding 
generalized  forces  that  are  necessary  to  maintain  surface  constraints. 

3.2.1  Coordinate  Frame  Representation 

The  Denavit-Hartenberg  representation  [53]  is  used  to  define  the 
kinematic  configuration  of  the  biped.  The  Denavit-Hartenberg  coordinate  frame 
representation  is  shown  in  Figure  3.2  for  link  ‘ij’  of  an  n-link  manipulator.  The  four 
parameters  ay,ay,dj,0j  completely  characterize  the  biped  kinematics.  The  angle 

ttij  is  called  the  twist  angle  of  link  ‘ij’.  The  length  represents  the  shortest 


Figure  3.2  - Denavit-Hartenberg  Notation 
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distance  between  joint  axis  ‘i’  and  joint  axis  ‘j’.  The  length  is  a joint  variable  if 

joint  ‘j’  is  a prismatic  joint,  and  the  axial  offset  of  link  ‘jk’  from  link  ‘ij’  if  otherwise. 
The  angle  0j  is  the  angle  between  adjacent  links  and  a joint  variable  if  joint  ‘j’  is 

a revolute  joint.  The  axis  system  (Xi,  yi,  Zi)  is  fixed  to  link  ‘ij’  and  is  referred  to  as 
the  ‘ij’  coordinate  system.  Table  3.1  shows  the  Denavit-Hartenberg  parameters 
for  the  planar  five-link  biped. 


Table  3.1  - Denavit-Hartenberg  Parameters  for  Planar  Five-Link  Biped 


Linky 

01 

12 

23 

34 

45 

56 

67 

7e 

tty; 

0° 

90° 

90° 

180° 

0° 

0 

0 

00 

0° 

q 

^ij- 

0 

0 

0 

L3 

L4 

0 

Le 

L7 

Zb 

X. 

0 

0 

0 

0 

0 

0 

90° 

90° 

03 

04 

05 

0b 

07 

0 

3.2.2  Equations  of  Motion 

The  equations  of  motion  are  formulated  using  the  Euler-Lagrange 
differential  equation  and  the  Denavit-Hartenberg  coordinate  frame 
representation.  The  derivation  is  widely  available  in  the  literature  and  is  included 
for  completeness  in  appendix  A.  This  formulation  allows  the  support  leg 
coordinates  to  be  easily  incorporated  by  assuming  massless  prismatic  joints  in 
each  dimension. 

The  resulting  coupled  nonlinear  second  order  differential  equations  of 


motion  can  be  expressed  in  the  form 
M(q)q  + H(q,q)  + G(q)  = Q , 


(3.1) 
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where  Q is  the  vector  of  generalized  forces  corresponding  to  the  generalized 
coordinates 


=[Pb,>Pb.> 


and  is  defined  as 


0,, 64, 05,06, 67]^ 


(3.2) 


Q = T + j/F,+j/x,  , 


where 


T = [F^ , T]^  = [Fb^ , F,^ , I3 , X4 , T5 , X6 , X7  V . 


(3.3) 


(3.4) 


T represents  the  supporting  leg  ground  reaction  forces  (f^  =[Fb  ,F^  ]^)  and 
applied  joint  torques (x  = [X3,X4,X,,X6,X3]^).  F^  =[F,  ,F,  represents  the  external 
load  applied  to  the  end  of  the  swing  limb,  and  x,  represents  the  external  torque 
applied  to  the  end  of  the  swing  limb.  and  are  the  Jacobian  matrices  which 
relate  free-end  linear  and  angular  velocities  to  joint  velocities.  Substitution  yields 
the  planar  five-link  biped  equations  of  motion 

Mq  + H + G = C,F,-t-C2X  + jjFf-hj/Xf  , (3.5) 


where 


C,= 


‘2x2 


0 


5x2, 


r = 

, V.^7 


'2x5 


‘5x5 


(3.6) 


The  matrices  M(q),H(q,q),G(q),  and  are  derived  symbolically  however 


complexity  prohibits  their  inclusion. 
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3.2.3  Equations  of  impact 

During  locomotion,  when  the  swing  limb  makes  contact  with  the  ground, 
the  generalized  velocities  will  experience  jump  discontinuities  as  a result  of  the 
impact.  The  impact  equations  characterize  the  instantaneous  change  in 
generalized  velocities  and  are  derived  using  the  principles  of  linear  and  angular 
impulse  and  momentum.  Rearranging  equation  (3.5)  and  integrating  overtime 
At  in  the  limit  as  At  0 we  obtain 


During  an  infinitesimal  collision  event  the  generalized  positions  remain 
unchanged  and  thus  the  second  term  on  the  left-hand  side  goes  to  zero  as 
At-^0.  Denoting  q"  =q(t)  and  q^  =q(t-i-At)  the  instantaneous  velocities 


before  and  after  the  impulse,  and  F = ^1™^  |f  the  impulsive  force,  we  obtain  a 


lim 

At^O 


J [Mq]dt  -I- 


lim 

At-^0 


J[H  + G-C2X-j/Xf]dt 


lim 

At^O 


to+AI 


Statement  of  the  principle  of  linear  impulse  and  momentum 


M(q^-q-)  = C,F,+jjF,  . 


(3.8) 


The  change  in  the  generalized  velocities  then  becomes 


Aq  = lVr’EF  , 


(3.9) 


where 
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E=[c,  JL'J,('  = [f;  F,]'  ■ 


(3.10) 


Using  the  definition  of  the  Jacobian  matrix  J,  , the  relationship  between  the 
change  in  leg  tip  linear  velocities  (p  = [Pb,Pr  ]^)  and  the  change  in  generalized 
velocities  is  given  by 

Ap  = E^Aq  . (3-11) 

Combining  equations  (3.9)  and  (3.1 1)  yields  an  expression  for  the  impulsive 
force  vector 


F = KAp  , (3.12) 

where 

K = [e'^M-'e]''  . (3.13) 

Substituting  equation  (3.12)  into  (3.9)  yields  impact  equations  for  the  planar  five- 
link  biped 

Aq  = M"‘EKAp  . (3.14) 

The  definition  of  the  coefficient  of  restitution  provides  the  additional  equation 
necessary  to  determine  the  change  in  leg  tip  linear  velocity.  The  coefficient  of 
restitution  e relates  pre-impact  surface  normal  velocity  to  post-impact  surface 
normal  velocity  assuming  non-deformable  rigid  bodies  as  follows 

Pz=-ep:-  (3.15) 


3.2.4  Ground  Reaction  Forces 

Once  the  basic  equations  of  motion  and  impact  equations  are  defined, 
application  to  all  phases  of  the  locomotion  process  is  reduced  to  solving  for  the 
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ground  reaction  forces  (forces  applied  at  the  ends  of  the  support  and  swing  legs) 
necessary  to  observe  the  surface  constraints.  In  the  impact  phases,  these 
ground  reaction  forces  are  impulsive.  The  potential  solution  space  is  shown  in 
table  3.2.  The  terms  ‘base’  and  ‘free’  refer  to  the  support  and  swing  legs 
respectively.  The  complete  derivation  of  the  ground  reaction  forces  during 
support  and  impact  phases  appears  in  appendices  B and  C respectively. 


Table  3.2  - Ground  Reaction  Forces 


No  slip 

Slip  (base) 

Slip  (free) 

Slip  (both) 

Single  Support 

X 

X 

n/a 

n/a 

Double  Support 

X 

X 

X 

X 

Single  Impact 

X 

n/a 

X 

n/a 

Double  Impact 

X 

X 

X 

X 

3.2.5  Switching 

If  the  locomotion  is  one  of  normal  progression  another  discontinuity  must 
occur  at  the  moment  of  impact.  Since  the  derivation  of  the  equations  of  motion 
assumes  a distinction  between  the  support  leg  and  the  swing  leg,  it  is  necessary 
to  exchange  the  roles  of  the  support  and  swing  legs  after  each  heel  strike.  This 
introduces  a mathematical  discontinuity  into  the  model  that  is  an  artifice  only  of 
the  modeling  technique.  For  the  planar  five-link  biped  the  switching  algorithm  is 
as  follows: 

63"  = 03-  - Qi  - + 0/  - 71  , (3. 1 6a) 

04^=  07'  . 


(3.16a) 
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(3.16a) 


9/  =0,'  +71 


(3.16a) 


(3.16a) 


where  the  “ and  * indicate  before  and  after  switching  respectively.  The  joint 
velocities  must  also  be  reset  according  to  the  time  derivative  of  the  above 
equations. 

3.2.6  Model  Flow 

Figure  3.3  shows  a high-level  flowchart  of  the  model  section  of  the 
simulation.  The  equations  of  motion  are  integrated  numerically  using  the  fourth 
order  Runge-Kutta  algorithm.  When  a heel  strike  is  detected  (i.e.,  the  swing  leg 
tip  position  integrates  below  the  floor),  the  integration  time  step  is  adjusted  until 
the  swing  leg  just  contacts  the  floor.  At  this  point  the  impact  equations  are  used 
to  determine  the  change  in  the  generalized  velocities  as  a result  of  the  impact. 
Once  the  velocities  are  adjusted,  the  support  and  swing  legs  are  switched  if 
warranted  by  the  locomotion  phase. 

It  is  necessary  during  the  simulation  to  apply  the  equations  of  motion  and 
impact  equations  appropriate  to  current  conditions.  This  requires  continuous 
boundary  condition  evaluation  and  equation  selection.  For  example  when 
operating  in  double  support  the  no-slip  equations  are  first  assumed,  the  resulting 
reaction  forces  are  checked  against  the  maximum  no-slip  forces  and  if  necessary 
slipping  equations  are  employed.  In  addition,  the  reaction  forces  must  be 
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checked  against  zero  (foot  lift)  and  if  necessary  single  support  equations 
employed. 


Figure  3.3  - Biped  Model  Flow  Chart 


3.2.7  Model  Scale 

Numerical  values  of  the  dimensions,  masses,  and  moments  of  inertia 
used  in  the  simulation  are  presented  in  table  3.3.  These  numbers  have  been 
chosen  to  roughly  approximate  a human  male. 
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Table  3.3  - Length,  Mass,  and  Moment  of  Inertia 


Link 

Length  (m) 

Mass  (Kg) 

Inertia  (Kg-m"^) 

1 

Zb 

0 

0 

2 

Xb 

0 

0 

3 

0.4 

3 

0.04 

4 

0.4 

7 

0.12 

5 

0.65 

20 

1.5 

6 

0.4 

7 

0.12 

7 

0.4 

3 

0.04 

3.3  Sensor  and  Actuator  Models 

Any  physically  realizable  system  will  involve  the  use  of  less  than  ideal 
control  components.  There  will  certainly  be  limitations  on  actuator  torque 
capability,  and  sensor  readings  are  bound  to  have  some  level  of  associated 
noise.  Certainly  both  actuators  and  sensors  will  have  some  limited  dynamic 
capability.  Representative  actuator  and  sensor  models  are  depicted  in  Figure 
3.4.  The  filter  time  constants  are  set  to  0.015  seconds  for  all  sensors  and 
actuators. 


(a) 


(b) 


q 

1 

+ ^ qs 

d 

qs 

xs  + 1 

j ^ 

dt 

NOISE 


Figure  3.4  - Actuator  and  Sensor  Models 
a)  Actuator  Model;  b)  Sensor  Model 
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3.4  Environment  Model 

The  environment  model  includes  the  gravitational  field  (held  constant  at 
g=9.81m/s),  and  the  ground  profile  which  is  variable.  The  coefficient  of  static 
friction  between  the  ground  and  the  robot  foot  is  variable.  The  ratio  of  static  to 
dynamic  friction  coefficients  was  held  to  1 .0  for  this  research.  The  coefficient  of 
restitution  between  the  ground  and  the  robot  foot  was  held  to  0.0  for  this 
research. 


CHAPTER  4 

CONTROL  ARCHITECTURE 


In  this  chapter  we  present  the  nominal  control  system  architecture. 
Functionally,  the  control  system  consists  of  the  three  primary  elements:  high- 
level  planning,  gait  synthesis,  and  tracking  control  as  presented  in  Chapter  1.  We 
design  the  nominal  control  system  keeping  in  mind  that  we  will  ultimately  need  to 
incorporate  reflexive  responses  and  perform  gait  optimization.  Successful 
incorporation  of  reflexes  will  be  strongly  influenced  by  the  formulation  of  the  gait 
synthesis  algorithm  and  the  definition  of  the  gait  parameters  it  will  obey.  Our 
ability  to  perform  intelligent  optimization  and  derive  meaningful  results  will  also 
be  closely  related  to  the  available  gait  parameters.  In  this  chapter  we  perform  an 
off-line  gait  optimization,  the  results  of  which  define  the  subspace  about  which 
the  stability  is  evaluated. 


4.1  Nominal  Control  System 

We  assume  a control  system  structure,  as  defined  in  Chapter  1 , 
comprised  of  the  three  primary  components:  high-level  planning,  gait  synthesis, 
and  tracking  control.  It  is  reasonable  to  assume  that  any  selected  tracking  control 
will  be  capable  of  adequately  tracking  the  joint  trajectories  produced  by  the  gait 
synthesis  algorithm.  Selection  of  a nominal  control  system  is  therefore  reduced 
to  formulating  a gait  synthesis  technique  and  defining  the  high-level  gait 
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parameters  it  will  obey.  In  formulating  the  control  system  architecture  we  keep  in 
mind  the  following  considerations.  The  control  system  should: 

• Accommodate  all  phases  of  locomotion  (progression,  standing,  starting, 
stopping)  at  various  speeds 

• Be  capable  of  foothold  selection  by  changing  step  height  and  length 
independently 

• Accommodate  various  surface  grades 

• Be  flexible  to  the  incorporation  of  reflexive  control  responses 

• Be  capable  of  accommodating  gait  optimization  and  adaptation 

• Be  simple. 

4.1.1  High-level  Planning 

The  high-level  planning  portion  of  the  control  algorithm  performs  a 
supervisory  function.  The  high-level  planning  algorithm  encompasses  sensor 
signal  processing  and  incorporation,  path  planning,  and  gait  parameter  selection. 
Path  planning  and  sensor  incorporation  have  received  considerable  attention  in 
the  literature.  This  research  focuses  on  the  gait  parameters  selection.  The  gait 
parameters  that  are  outputs  of  the  planning  algorithm  should  provide  the 
necessary  framework  to  dictate  the  biped  motion  at  a high-level  of  abstraction. 
These  gait  parameters  are  fed  directly  into  the  gait  synthesis  algorithm  that 
converts  this  high-level  information  into  specific  joint  trajectory  commands. 
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Figure  4.1  - Overview  of  High-level  Planning 


Figure  4.1  shows  that  the  high-level  planning  algorithm  accepts  only  four 
operator  commands:  start,  stop,  velocity,  and  direction.  It  is  expected  that  the 
high-level  sensor  information  will  be  processed  and  made  available  to  the  path 
planning  algorithm  (not  shown).  Apart  from  path  planning,  the  high-level  planning 
algorithm  consists  of  two  primary  functions:  phase  selection,  and  gait  parameter 
selection.  The  phase  selector  chooses  an  appropriate  locomotion  phase  (LP) 
based  on  the  commanded  inputs  and  available  sensor  information.  The  phase 
selector  acts  as  a finite  state  machine.  Figure  4.2  depicts  the  allowable  states 
and  transition  paths.  Transitions  to  starting  and  stopping  are  triggered  by  the 
external  commands  while  transitions  to  progression  and  standing  are  a function 
of  the  model  state.  The  gait  parameter  selection  algorithm  sets  the  high-level  gait 
parameters  appropriate  to  the  locomotion  phase  and  in  response  to  the 
commanded  inputs  and  available  sensor  information.  The  goal  of  the  gait 
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T.  Stopping  T 

Figure  4.2  - Phase  Selector  State  Diagram 

parameter  selection  algorithm  is  to  choose  the  optimal  set  of  high-level  gait 
parameters  given  the  locomotion  phase,  commanded  inputs,  and  terrain.  The 
definition  of  optimal  may  vary  between  locomotion  phases  and/or  within  a single 
phase.  While  in  the  progression  phase  it  will  usually  be  desirable  to  choose  gait 
parameters  that  minimize  the  control  power.  The  gait  parameter  selection 
algorithm  is  discussed  further  in  section  4.2,  which  focuses  on  gait  optimization. 

The  formulation  of  the  high-level  gait  parameters  builds  upon  the  work  of 
Hurmuziu  [37],  The  formulation  shown  here  has  removed  the  built-in 
assumptions  of  posture  and  swing  leg  tip-to-hip  ratio  in  single  support  mode,  and 
added  the  parameters  necessary  to  fully  characterize  the  biped  in  double  support 
mode.  A number  of  the  gait  parameters  we  have  defined,  are  not  fundamentally 
necessary  to  achieve  successful  locomotion.  Several  of  the  gait  parameters 
could  be  eliminated  or  held  constant  and  successful  locomotion  still  achieved. 

We  have  introduced  these  additional  gait  parameters  with  the  expectation  that 
they  will  allow  us  to  realize  the  desired  gait  in  a more  efficient  manner.  Through 
optimization  we  hope  to  define  combinations  of  these  gait  parameters  that  will 
minimize  a cost  function  over  the  course  of  the  gait  cycle.  The  planning  algorithm 
output  parameters  for  the  planar  five-link  biped  are  as  follows: 
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• LP  - Locomotion  phase.  Under  the  nominal  control  presented  here, 
the  locomotion  phase  is  restricted  to  Progression,  Standing,  Starting,  and 
Stopping.  We  will  introduce  reflexive  phases  of  locomotion  in  Chapter  6. 

• Sli  - Initial  step  length.  The  initial  step  length  is  defined  as  the 
horizontal  separation  of  swing  and  support  leg  tips  at  the  beginning  of  the 
step.  Figure  4.3  illustrates  initial  step  length  in  relation  to  the  swing  leg  tip 
trajectory.  In  the  figure,  the  support  leg  tip  is  at  the  origin.  Initial  step  length  is 
valid  only  in  single  support  mode. 

• SIf  - Final  step  length.  The  final  step  length  is  defined  as  the 
horizontal  separation  of  swing  and  support  leg  tips  at  the  end  of  the  step  (the 
moment  the  swing  leg  contacts  the  ground).  Figure  4.3  illustrates  final  step 
length  in  relation  to  the  swing  leg  tip  trajectory.  Final  step  length  is  valid  only 
in  single  support  mode. 

• Shi  - Initial  step  height.  The  initial  step  height  is  the  vertical 
separation  of  swing  and  support  leg  tips  at  the  beginning  of  the  step  (when 
the  horizontal  separation  equals  the  initial  step  length).  When  the  walking 
surface  is  flat  and  level  the  initial  step  height  is  zero.  Figure  4.3  illustrates 
initial  step  height  in  relation  to  the  swing  leg  tip  trajectory.  Initial  step  height  is 
valid  only  in  single  support  mode. 

• Shf  - Final  step  height.  The  final  step  height  is  the  expected  vertical 
separation  of  swing  and  support  leg  tips  at  the  end  of  the  step  (when  the 
horizontal  separation  equals  the  final  step  length).  When  the  walking  surface 
is  flat  and  level  the  expected  final  step  height  is  zero.  Figure  4.3  illustrates 
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final  step  height  in  relation  to  the  swing  leg  tip  trajectory.  Final  step  height  is 
valid  only  in  single  support  mode. 

• Shm  - Midpoint  step  height.  The  midpoint  step  height  is  defined  as 
the  vertical  separation  of  swing  and  support  leg  tips  midway  between  initial 
and  final  horizontal  separation.  When  the  walking  surface  is  flat  and  level  this 
corresponds  to  the  maximum  swing  leg  tip  clearance  above  the  ground. 
Figure  4.3  illustrates  midpoint  step  height  in  relation  to  the  swing  leg  tip 
trajectory.  Midpoint  step  height  is  valid  only  in  single  support  mode. 


Zf 


Figure  4.3  - Swing  Leg  Tip  Trajectory  Parameters 

• Vp  - Progression  velocity.  The  progression  velocity  is  defined  for 
the  planar  biped  as  the  tangential  (parallel  to  the  walking  surface)  velocity  of 
the  hip  joint.  Progression  velocity  can  be  positive  or  negative.  Progression 
velocity  is  illustrated  in  Figure  4.4.  Vp  is  used  in  both  single  and  double 
support  modes. 

• Kb  - Stance  knee  bias.  The  stance  knee  bias  is  defined  as  the 
angle  between  the  upper  and  lower  portions  of  the  supporting  leg.  This 
corresponds  to  0^  for  the  planar  biped  in  Figure  3.1 . Stance  knee  bias  is 
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illustrated  in  Figure  4.4.  Stance  knee  bias  is  used  in  both  single  and  double 
support  modes. 

• Pa  - Posture  angle.  The  posture  angle  represents  the  angle  of  the 
biped  torso  with  respect  to  the  vertical.  This  corresponds  to  63  -0^  -0,  for 

the  planar  biped  in  Figure  3.1.  Posture  angle  is  illustrated  in  Figure  4.4.  Pa  is 
used  in  both  single  and  double  support  modes. 


Figure  4.4  - Progression  Velocity,  Knee  Bias,  and  Posture  Angle 

• Hf  - Flip  fraction.  The  hip  fraction  defines  the  steady  state 
relationship  between  the  horizontal  position  of  the  hip  joint  and  the  horizontal 
separation  of  the  support  and  swing  leg  tips.  Hip  fraction  allows  adjustment  of 
the  hip  position  relative  to  the  base  of  support.  A value  of  Hf=0.5  positions  the 
hip  midway  between  leg  tips,  Hf>0.5  forward,  and  Hf<0.5  rearward.  Hip 
fraction  is  used  in  both  single  and  double  support  modes.  Figure  4.5  shows 
how  hip  fraction  relates  the  hip  and  swing  leg  tip  positions. 
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(a)  (b) 


Figure  4.5  - Hip  Fraction  Definition 
a)  Mathematical  relationship;  b)  Visualization  diagram; 


• Tpc  - Tip  phase  coefficient.  The  tip  phase  coefficient  represents 
the  dynamic  relationship  between  the  horizontal  position  of  the  tip  of  the 
swing  leg  and  that  of  the  hip.  Tip  phase  coefficient  is  the  dynamic  equivalent 
of  hip  fraction.  Tip  phase  coefficient  affects  the  timing  of  the  swing  leg  tip’s 
horizontal  movement.  Positive  values  of  tip  phase  coefficient  cause  the  swing 
leg  tip  to  lead  the  hip  while  negative  values  cause  it  to  lag.  See  Figure  4.6. 
Tpc  is  valid  only  in  single  support  mode. 

• Kpc  - Knee  phase  coefficient.  The  Knee  phase  coefficient 
represents  the  mid-step  variation  about  the  commanded  knee  bias  set  point. 


Figure  4.6  - Effect  of  Tip  Phase  Coefficient 
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Knee  phase  coefficient  is  analogous  to  tip  phase  coefficient  in  that  it  is  purely 
dynamic.  Kpc  is  valid  only  in  single  support  mode. 

• Ppc  - Posture  phase  coefficient.  The  posture  phase  coefficient 
represents  the  magnitude  of  mid-step  variation  about  the  commanded 
posture  angle  set  point.  Ppc  is  the  direct  analogy  of  Kpc  applied  to  the 
posture  angle.  Ppc  is  valid  only  in  single  support  mode. 

• Fr  - Force  ratio.  The  force  ratio  is  the  ratio  of  the  vertical  ground 
reaction  force  under  the  swing  leg  tip  to  the  ‘minimum  control  energy’  vertical 
ground  reaction  force.  The  ‘minimum  control  energy’  ground  reaction  force  is 
that  static  force  that  would  occur  if  the  support  ankle  torque  was  equal  to 
zero.  Force  ratio  allows  the  use  of  joint  torques  to  manipulate  the  force  under 
the  free  leg  independent  of  the  biped  position.  Force  ratio  is  valid  only  in 
double  support  mode. 

• Xd-  Vector  of  desired  bandwidths.  The  vector  of  desired 
bandwidths  is  passed  directly  to  the  tracking  control,  bypassing  the  gait 
synthesis  algorithm.  The  tracking  control  utilizes  the  desired  bandwidth  vector 
to  set  the  proportional  and  derivative  gains  for  each  control  loop.  We  include 
the  desired  bandwidth  as  a gait  parameter  for  simplicity. 

4.1.2  Gait  Synthesis 

The  primary  function  of  the  gait  synthesis  algorithm  is  translating  the  high- 
level  gait  parameters  into  specific  desired  joint  trajectories  that  are  physically 
realizable.  The  high-level  gait  parameters  will  be  obeyed  only  within  the 
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kinematic  constraints  of  the  system.  Strict  adherence  to  the  commanded  gait 
parameters  may  also  occasionally  be  sacrificed  in  favor  of  continuous  joint 
trajectory  derivatives.  Much  of  the  gait  synthesis  algorithm  is  locomotion  phase 
dependent. 

In  the  single  support  (progression)  phase  the  desired  joint  trajectories  are 
chosen  to  satisfy  the  following  gait  parameters:  Vp,  Kb,  Pa,  Sli , SIf,  Shi,  Shf, 

Shm,  Hf,  Kpc,  Ppc,  and  Tpc.  Figure  4.7  shows  the  relationship  between  these 
gait  parameters  and  the  joint  trajectories  at  a high-level.  The  progression  velocity 
and  stance  knee  bias  set  the  support  leg  ankle  and  knee  trajectories  (83 , 6J 

directly.  Posture  angle  and  biped  kinematics  combine  to  determine  the  support 
leg  hip  joint  trajectory  ( 65 ).  The  hip  trajectory  ( ) is  fully  determined  by  support 

leg  ankle  and  knee  trajectories.  The  swing  leg  tip  trajectory  calculations 
incorporate  the  hip  trajectory,  step  length,  step  height,  hip  fraction,  and  the  tip 


Figure  4.7  - Gait  Synthesis  (Progression) 
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phase  coefficient.  Once  the  trajectories  of  the  hip  and  swing  leg  tip  are 
determined,  inverse  kinematics  is  required  to  obtain  the  swing  leg  hip  and  knee 
joint  trajectories  ( 9^ , 0^). 

The  starting  and  stopping  phases  utilize  essentially  the  same  gait 
synthesis  algorithm  described  above.  This  is  made  possible  by  our  formulation 
which  allows  for  arbitrary  initial  and  final  leg  tip  positions.  The  gait  synthesis  in 
the  stopping  phase  differs  slightly  from  that  of  the  starting  and  progression 
phases.  When  the  stopping  phase  is  initiated,  the  final  resting  configuration  is 
determined.  Smooth  joint  trajectories  are  then  computed  to  achieve  this 
configuration  within  a desired  increment  of  time.  This  allows  a near  zero  velocity 
profile  at  final  impact  resulting  in  double  support. 

In  the  double  support  (standing)  phase  the  desired  joint  trajectories  are 
chosen  to  satisfy  the  following  gait  parameters:  Kb,  Pa,  Hf,  and  Fr.  Figure  4.8 
shows  the  relationship  between  these  gait  parameters  and  the  joint  trajectories 
at  a high-level.  In  the  standing  phase  the  leg  tip  positions  are  known  and  should 
not  change.  The  commanded  hip  fraction  and  progression  velocity  are  used  to 
calculate  the  desired  hip  position.  The  hip  position  and  stance  knee  bias  (S^) 
combine  through  inverse  kinematics  to  obtain  the  desired  ankle  trajectory  (B,). 

Posture  angle  and  biped  kinematics  combine  to  determine  the  support  leg  hip 
trajectory  (65).  Finally,  inverse  kinematics  is  required  to  obtain  the  swing  leg  hip 

and  knee  joint  trajectories  (0^,  0,).  The  force  ratio  is  used  in  double  support 

mode  to  determine  the  desired  ground  reaction  force  under  the  swing  leg  tip  (Ff  ). 
A force  ratio  of  1 .0  (nominal)  results  in  a normal  distribution  of  ground  reaction 
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Figure  4.8  - Gait  Synthesis  (Standing) 


force.  Force  ratios  between  1 .0  and  0.0  reduce  the  swing  leg  ground  reaction 
force  from  nominal  to  zero  while  simultaneously  increasing  the  support  ankle 
torque.  A detailed  derivation  of  the  gait  synthesis  equations  in  both  progression 
and  standing  phases  is  included  in  Appendix  D. 

4.1.3  Tracking  Control 

The  control  function  is  closed-loop  tracking  of  the  desired  joint  trajectories 
that  are  input  from  the  gait  synthesis  algorithm.  We  have  chosen  to  implement  a 
robust  control  technique  known  as  sliding  mode  control.  We  first  present  the 
pure  feedback  linearization  technique  known  as  computed  torque  control.  We 
then  augment  the  basic  design  with  the  presentation  of  sliding  mode 
compensation. 
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4.1. 3.1  Computed  torque  control 

We  have  shown  that  the  dynamic  performance  of  the  planar  biped  is 
governed  by  the  equations  of  motion  (3.5),  repeated  here  for  convenience. 

M(q)q  + H(q,q)  + G(q)  = C,F, +C2T  + JJq)^Ff +JJq)'^X,  . (4.1) 

For  simplification  we  define 

h = h(q,q,Ff,Xf ) = H(q,q)  + G(q)- JL(q)'^Ff  - J^(q)'^Tf  . (4.2) 

The  equations  of  motion  can  then  be  rewritten  in  the  following  form 

T = Mq  + h . (4.3) 

The  computed  torque  control  is  based  on  the  use  of  a control  law  structure  that 
is  as  close  as  possible  to  that  of  the  system  equations  of  motion.  We  choose  a 
control  structure  as  follows 

T = Mu  + h , (4.4) 

where  M and  h are  the  control  model  estimates  of  the  system  terms  M and  h . 
If  accurate  system  models  are  available  M = M , h = h then  substitution  of  (4.4) 
into  (4.3)  yields  de-coupled  second  order  equations  of  the  form 

q = u . (4.5) 

A suitable  linear  control  law  such  as  proportional  plus  derivative  may  then  be 
applied  to  achieve  critical  damping  at  the  desired  bandwidth  {X) 

u = q^ -2Xq-A,^q  , (4.6) 

where  q = q-qj  and  q^  is  the  desired  trajectory.  The  resulting  closed-loop 


equation  for  the  joint  position  error  e is  given  by 

e + KjC  + KpC  = 0 . 


(4.7) 
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Figure  4.9  illustrates  the  closed-loop  computed  torque  control  structure  as 
applied  to  the  planar  biped. 


Figure  4.9  - Computed  Torque  Control  Structure 


The  computed  torque  control  technique  provides  excellent  tracking  when 
the  system  is  well  approximated  by  the  control  model.  In  practice  the  control 
model  is  often  quite  distinct  from  the  system  model  M M , h h . When  this  is 
the  case,  substitution  of  (4.4)  into  (4.3)  results  in  coupled  second  order 
equations 

q = M'’(h-h)  + (M-'M)u  . (4.8) 

In  this  situation,  a linear  control  law  may  lead  to  inadequate  performance.  A 
number  of  control  techniques  are  available  to  remedy  this  problem.  We  present 
here  the  robust  control  technique  known  as  sliding  mode  control. 
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4.1. 3.2  Sliding  mode  control 

Robust  controllers  are  typically  comprised  of  a nominal  part,  and 
additional  terms  aimed  at  compensating  for  the  model  uncertainty.  The  sliding 
mode  control  technique  is  a simple  approach  to  robust  control  that  is  based  on 
the  premise  that  it  is  easier  to  control  a first-order  system  than  a second-order 
(or  higher)  system.  The  sliding  mode  design  introduces  a notational 
simplification,  in  the  form  of  the  sliding  surface,  which  allows  the  second-order 
(or  higher)  system  to  be  replaced  by  an  equivalent  first-order  system.  We  choose 
a sliding  surface  to  be  a well-behaved  function  of  the  tracking  error  and  thereby 
transform  our  second  order  tracking  problem  into  a first  order  stabilization 
problem.  Choosing  a control  law  (u)  that  satisfies  a sliding  condition  will  solve  the 
simplified  first  order  stabilization  problem.  The  sliding  condition  ensures  that  the 
squared  distance  to  the  sliding  surface  decreases  along  all  system  trajectories. 
Once  on  the  surface  the  system  trajectories  remain  on  the  surface.  The  sliding 
mode  control  equations  are  derived  in  Appendix  E. 

The  sliding  controller  has  the  same  form  as  equation  (4.4)  with  the  control 
input  determined  by 


u,  = 


Ri(q)[u;  -Ki(q,q)  sat(Si/0.)] 


(4.9) 


where 


(4.10) 


The  primary  difference  between  the  sliding  mode  controller  above  and  the 
computed  torque  control  law  of  equation  (4.4),  is  the  existence  of  the  term 
Rj(q)  ■ Kj(q,q)  sat(sj/4>i).  This  term  ensures  stability  and  consistent 
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performance  in  the  face  of  model  uncertainty.  The  values  of  the  control  gains 
Ri(q),Ki(q,q)  and  boundary  layer  thickness  tt»,  are  computed  according  to  the 
equations  of  Appendix  E and  are  based  on  the  known  uncertainty  bounds  of 
M(q)  and  h = h(q,q,Ff,tf ) . Figure  4.10  illustrates  the  closed-loop  sliding  mode 
control  structure  as  applied  to  the  planar  biped. 


Figure  4.10  - Sliding  Mode  Control  Structure 


The  advantage  of  sliding  mode  control  over  computed  torque  control  is 
clear  in  the  presence  of  even  moderate  levels  of  parametric  uncertainty.  To 
demonstrate  this  superiority  we  have  injected  varying  levels  of  parametric 
uncertainty  into  the  control  model  in  the  form  of  uncertainties  in  the  member 
masses,  lengths,  moments  of  inertia,  and  center  of  gravity  position.  Figure  4.1 1 
shows  the  relative  tracking  error  of  the  two  algorithms  as  the  control  model 
uncertainty  is  increased.  Tracking  errors  were  calculated  during  a standard  gait 
over  a flat  and  level  surface.  The  individual  joint  errors  were  averaged  to  produce 
a single  representative  number.  The  uncertainty  values  for  member  length  (e,) 
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and  center  of  gravity  position  (ej  were  held  fixed  at  10%  while  the  uncertainty 
values  for  mass  (e„, ) and  moment  of  inertia  (e, ) were  varied  together  from  0 to 
50%. 


Figure  4. 11  - Comparison  of  Control  Algorithm  Robustness 


4.2  Gait  Optimization 

With  the  gait  parameters  established  and  the  tracking  control  system  in 
place  we  are  now  in  a position  to  complete  the  gait  parameter  selection  portion 
of  the  high-level  planning  task.  The  goal  of  the  gait  parameter  selection  algorithm 
is  to  choose  the  set  of  high-level  gait  parameters  that  will  optimize  biped 
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performance  given  the  locomotion  phase,  commanded  inputs,  and  terrain.  In  this 
section  we  present  the  results  of  our  off-line  gait  optimization. 

4.2.1  Optimization  Variables  and  Cost  Function 

An  operational  bipedal  locomotion  robot  will  likely  spend  a large  majority 
of  its  time  and  energy  in  the  single  support  (progression)  phase  of  locomotion.  It 
makes  sense  therefore  to  concentrate  our  optimization  efforts  in  this  phase.  In 
the  progression  phase  the  gait  parameter  selection  algorithm  must  choose  the 
optimal  combination  of  8 gait  parameters.  These  parameters  are  as  follows:  step 
length,  step  height,  knee  bias,  hip  fraction,  posture  angle,  tip  phase  coefficient, 
knee  phase  coefficient,  and  posture  phase  coefficient.  We  assume  for  our  off- 
line analysis  that  the  surface  grade  is  fixed  and  known,  and  that  the  desired 
progression  velocity  must  be  achieved.  We  therefore  seek  the  optimal 
combination  of  the  aforementioned  gait  parameters  given  the  surface  grade  and 
progression  velocity. 

Under  normal  circumstances  the  biped  performance  measure  that  is  most 
desirable  to  minimize  is  total  control  power.  Minimizing  control  power  has  several 
obvious  advantages.  In  the  design  phase,  reduction  of  total  control  power  may 
lead  to  the  selection  of  smaller,  lighter,  and  less  expensive  torque  motors.  In  the 
operational  phase,  reduced  control  power  will  increase  battery  life  and  therefore 
improve  robot  usefulness. 

Of  fundamental  importance  to  the  optimization  process  is  the  method  by 
which  the  cost  function  is  calculated.  Several  methods  were  considered.  The  first 
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two  methods  calculated  the  cost  of  progression  over  a specified  time  and  over  a 
specified  distance.  These  methods  were  rejected  since  the  time  required  to 
reach  a steady  progression  varies  with  the  optimization  variables  themselves. 
Furthermore  it  was  determined  that  the  impulsive  forces  sustained  by  the  biped 
upon  collision  with  the  walking  surface  represent  non-trivial  disturbances  which 
must  be  rejected  by  the  control  system.  To  correct  these  shortcomings  it  was 
determined  that  the  optimization  cost  function  would  be  calculated  over  a fixed 
number  of  step  cycles  rather  than  over  a fixed  time  or  distance.  This  ensures 
equality  with  respect  to  impulsive  collisions.  Since  step  length  is  one  of  the 
optimization  variables  it  is  obvious  that  if  the  cost  function  is  calculated  over  a 
fixed  number  of  step  cycles,  a shorter  step  length  will  result  in  a lower  total 
control  power.  The  cost  function  was  therefore  normalized  by  step  length  to 
obtain  a cost  per  unit  length. 

4.2.2  Practical  Considerations 

After  a cursory  analysis  of  the  proposed  optimization  we  conclude  that  the 
minimum  power  gait  will  always  lie  in  the  direction  of  minimum  step  height.  Very 
small  step  heights  are  obviously  not  of  practical  interest.  One  possible  solution  is 
the  selection  of  a fixed  minimum  step  height  to  be  observed  for  all  surface 
grades  and  progression  velocities.  At  the  higher  progression  velocities  tracking 
error  is  likely  to  increase  thereby  increasing  the  risk  of  premature  ground  contact 
if  step  height  is  too  small.  A more  appealing  solution  is  to  link  step  height  to  step 
length  by  a fixed  ratio.  Since  gaits  with  higher  progression  velocity  are  likely  to 
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have  larger  step  lengths,  a direct  relationship  intuitively  makes  sense.  With  step 
height  a fixed  percentage  of  step  length,  the  number  of  optimization  variables  is 
reduced  to  7. 

An  unconstrained  optimization  of  total  control  power  using  these  7 
progression  gait  parameters  represents  a non-trivial  task.  The  dimensionality  of 
the  proposed  problem  is  relatively  high.  High  dimension  optimization  problems 
are  more  sensitive  to  scaling  and  variability,  and  are  therefore  more  difficult 
numerically.  There  exists  a high  degree  of  gait  parameter  coupling  that  translates 
into  a very  featured  optimization  surface  thereby  increasing  the  challenge.  The 
fixed  control  bandwidth  and  inherent  plant  dynamics  mean  the  control  tracking 
performance  will  degrade  with  increased  system  velocities  causing  variations  in 
the  cost  function. 

To  make  the  problem  more  tractable  we  decided  to  break  the  optimization 
into  two  parts  thereby  pursuing  a sub-optimal  solution.  First  we  determined  the 
optimum  settings  for  step  length,  knee  bias,  hip  fraction,  and  posture  angle  with 
the  phase  coefficients  set  to  zero.  Once  this  solution  was  obtained  and  in  place, 
the  phase  coefficients  were  then  optimized.  This  approximation  reduced  our 
single  7 variable  optimization  task  into  two  sequential  tasks  of  4 and  3 variables 
respectively. 

4.2.3  Optimization  Results 

We  selected  a downhill  simplex  method  due  to  Nelder  and  Mead  [54]  to 
perform  the  off-line  optimization.  The  cost  function  was  total  control  power, 
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calculated  at  every  compute  cycle  and  accumulated  over  two  step  cycles.  The 
calculation  was  initiated  at  the  time  of  impact  of  the  third  step  after  stable  gait 
was  established  and  terminated  after  impact  of  the  fifth  step.  Step  height  was 
constrained  to  be  10%  of  the  step  length  (5%  of  stride  length).  The  optimizations 
were  performed  over  a matrix  of  surface  grades  and  progression  velocities. 
Surface  grades  at  -10,  -5,  0,  5,  and  10  degrees  were  evaluated  at  ten 
progression  velocities  evenly  spaced  between  0.1  and  1.0  meters/second. 

Figure  4.12  contains  the  results  of  the  optimization  process.  Sub-optimal 
gait  parameter  settings  are  plotted  versus  surface  grade  and  progression 
velocity.  Shown  in  the  figure  are  step  length,  hip  fraction,  posture  angle,  knee 
bias,  and  primary  phase  coefficients  (tip,  knee,  and  posture).  Some  of  the  gait 
parameters  showed  little  or  no  cost  variation  with  respect  to  surface  grade  or 
progression  velocity.  In  these  cases,  the  results  have  been  averaged  to  produce 
a clearer  picture  of  the  underlying  trends. 

As  expected  step  length  shows  a generally  increasing  trend  with  respect 
to  progression  velocity,  although  the  slope  shallows  significantly  at  higher 
velocity  (Figure  4.12a).  This  slope  decrease  is  likely  due  to  our  constraint  on  step 
height,  larger  step  lengths  come  with  larger  step  heights.  The  shape  of  this  curve 
represents  the  blending  of  the  benefit  of  larger  step  length  and  the  cost  of  larger 
step  height.  In  Figure  4.12b  we  see  that  hip  fraction  displays  virtually  no  cost 
variation  with  respect  to  progression  velocity  when  the  surface  is  level  preferring 
an  even  split  (Hf=0.5).  The  situation  changes  dramatically  when  the  surface  is 
graded  up  or  down.  As  shown  in  the  figure,  hip  fraction  is  inversely  related  to 
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Figure  4.12  - Sub-optimal  Gait  Parameters  versus  Progression  Velocity 

and  Surface  Grade 

a)  Step  length;  b)  Hip  fraction;  c)  Posture  angle;  d)  Knee  bias;  e)  Tip  phase 
coefficient;  f)  Knee  phase  coefficient;  g)  Posture  phase  coefficient 
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surface  slope  with  a much  stronger  relationship  at  the  higher  velocities.  Posture 
angle  has  a very  slight  correlation  to  surface  grade  but  tends  to  be  backward 
leaning  at  low  velocity  and  forward  leaning  at  high  velocity  (Figure  4.12c).  Knee 
bias  showed  virtually  no  effect  on  total  control  power  regardless  of  the  surface 
grade  or  progression  velocity.  However,  knee  bias  plays  a crucial  role  in 
establishing  the  kinematic  constraints  of  the  bipedal  gait  since  there  is  a 
minimum  knee  bias  that  is  required  to  avoid  the  swing  leg  knee  singularity 
(07=0).  The  minimum  knee  bias  is  a function  of  the  step  length,  hip  fraction,  leg 
member  lengths,  surface  grade,  and  the  desired  minimum  value  of  the  swing  leg 
knee.  Figure  4.1 2d  shows  the  minimum  required  knee  bias  to  maintain  a swing 
leg  knee  angle  of  at  least  20  degrees  given  the  step  length,  hip  fraction,  surface 
grade,  and  leg  lengths.  Details  of  the  kinematic  relationship  are  available  in 
Appendix  D.  With  these  results  in  place  the  second  part  of  the  optimization  was 
performed.  The  phase  coefficients  showed  very  little  cost  variation  with  surface 
grade  and  the  results  were  therefore  averaged  in  that  direction.  There  is 
significant  variation  with  progression  velocity  as  can  be  seen  in  the  figure. 

Figure  4.13  shows  a graphical  representation  of  some  of  the  sub-optimal 
gait  parameters  at  the  time  of  surface  contact.  Step  length,  knee  bias  and 
posture  angle  are  detectable  from  the  diagrams  at  various  grades  and 
progression  velocities. 

It  not  reasonable  to  presume  we  have  achieved  a globally  or  even  locally 
optimal  gait  via  the  off-line  analysis.  Many  aspects  of  the  actual  robot  and 
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Figure  4.13  - Graphical  Display  of  Sub-optimal  Gait  Parameters 
a)  Grade=1 0,  Vp=0. 1 ; b)  Grade=1 0,  Vp=0.5;  c)  Grade=1 0,  Vp=0.9; 
d)  Grade=0,  Vp=0.1 ; e)  Grade=0,  Vp=0.5;  f)  Grade=0,  Vp=0.9; 
g)  Grade=-10,  Vp=0.1;  h)  Grade=-10,  Vp=0.5;  i)  Grade=-10,  Vp=0.9 


environment  are  likely  to  be  slightly  different  than  our  simulation.  The  off-line 
optimization  results  are  nonetheless  a valuable  starting  point  for  an  on-line  gait 
optimization  algorithm.  Any  on-line  optimization  algorithm  will  benefit  from  a good 
initial  guess  in  terms  of  convergence  speed  and  avoidance  of  local  minima. 


CHAPTER  5 

CAPABILITY  AND  SUSCEPTIBILITY 


With  the  nominal  control  system  fully  in  place,  we  now  demonstrate  the 
basic  capability  of  the  bipedal  locomotion  system.  The  robot  is  capable  of 
starting,  walking  on  various  surface  grades  at  various  speeds,  stopping  and 
changing  configuration  while  in  double  support  (standing)  phase.  In  this  chapter 
we  demonstrate  the  capabilities  of  the  system  on  a wide  variety  of  locomotion 
tasks.  Although  the  nominal  control  scheme  works  quite  well  under  normal 
conditions,  it  is  not  invincible.  The  biped  is  susceptible  to  failure  following 
common  ground  contact  errors  such  as  slipping  and  tripping.  We  will 
demonstrate  the  susceptibility  of  the  system  to  loss  of  stability  as  a result  of 
slipping  and  tripping. 


5.1  Capability 

In  this  section  we  demonstrate  the  ability  to  traverse  various  grade  terrain 
of  known  profile  at  various  speeds.  We  have  exercised  the  model  over  a wide 
range  of  surface  grades  and  progression  velocities.  We  will  highlight  the  basic 
capabilities  with  a few  representative  cases.  We  demonstrate  locomotion  over 
three  distinct  grades  (level,  +10  degrees,  -10  degrees)  at  a relatively  slow  speed 
(0.2  m/sec)  and  at  a relatively  fast  speed  (0.8  m/sec).  In  each  case,  the  selected 
gait  parameters  are  derived  from  the  results  of  the  gait  optimization  (section  4.2) 
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and  vary  with  speed  and  surface  grade.  In  addition  to  traversing  terrain  of  known 
profile  we  will  demonstrate  the  ability  of  the  control  scheme  to  accommodate  a 
surface  of  unknown  and  varying  profile.  Control  of  the  bipedal  robot  in  double 
support  (standing)  phase  is  also  demonstrated. 

5.1.1  Progression:  Known  Level  Grade 

Starting  and  normal  progression  on  a level  surface  is  depicted  in  Figures 

5.1  and  5.2.  The  horizontal  and  vertical  positions  of  the  swing  (free)  leg  tip  are 
plotted  versus  time  at  the  top  of  each  figure.  Also  shown  versus  time  are  the  five 
joint  angles,  and  the  applied  joint  torques.  At  the  bottom  of  each  figure,  the  swing 
leg  tip  trajectory  is  plotted  as  well  as  a gait  visualization  diagram.  Visible  are  step 
discontinuities,  with  respect  to  time,  of  leg  tip  translation  and  several  joint  angles. 
These  discontinuities  are  the  result  of  the  previously  mentioned  switching 
algorithm.  They  are  an  artifice  of  the  modeling  technique  and  are  as  expected. 

Figure  5.1  demonstrates  a level  grade  progression  at  0.2  meter/second,  a 
step  length  of  0.17  meters,  and  a step  height  of  1 .7  centimeters.  The  stance 
knee  bias  is  commanded  to  20.0  degrees,  posture  angle  to  -3.8  degrees,  and  hip 
fraction  to  0.5.  The  tip,  knee,  and  posture  phase  coefficients  are  0.006,  0.0027, 
and  -0.018  respectively.  The  positive  value  for  tip  phase  coefficient  means  we 
can  expect  the  horizontal  velocity  of  the  swing  leg  tip  to  be  slightly  larger  at  the 
end  of  the  step  than  it  is  at  the  beginning.  The  slightly  positive  value  for  knee 
phase  indicates  that  the  commanded  knee  bias  will  start  and  finish  at  the 
nominal  level  (20  degrees)  but  will  vary  to  a slightly  larger  value  through  the 
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Figure  5.1  - Progression,  Known  level  grade,  0.2  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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course  of  the  step.  The  negative  posture  phase  coefficient  indicates  the 
commanded  posture  angle  will  vary  from  the  nominal  level  (-3.8  degrees)  to  an 
even  more  negative  value  (nearly  -5.0  degrees).  The  figure  shows  smooth 
stable  progression.  Except  for  the  effect  of  impact,  the  stance  knee  bias  (0^ ) 
remains  very  close  to  the  nominal  command  of  20  degrees.  This  is  indicative  of  a 
level  grade,  balanced  hip  fraction  gait.  The  other  joint  trajectories  show  relatively 
little  variation  from  their  target  paths.  The  joint  torques  are  well  within  the 
practical  limit  for  reasonably  sized  electric  or  elctro-hydraulic  actuators.  The 
largest  torque  levels  occur  just  after  heel  strike  where  the  tracking  errors  are 
largest  as  a result  of  sustaining  the  impact. 

Figure  5.2  demonstrates  a level  grade  progression  at  0.8  meter/second,  a 
step  length  of  0.46  meters,  and  a step  height  of  4.6  centimeters.  The  stance 
knee  bias  is  commanded  to  20.0  degrees,  posture  angle  to  0.75  degrees,  and 
hip  fraction  to  0.5.  The  tip,  knee,  and  posture  phase  coefficients  are  -0.077,  0.03, 
and  -0.049  respectively.  Once  again  the  figure  shows  smooth  stable 
progression.  The  effect  of  impact  is  slightly  larger  here  than  in  the  previous  case 
due  to  the  higher  velocities.  Despite  this  and  the  much  lager  commanded  mid- 
step variation,  the  stance  knee  bias  (0^)  remains  relatively  close  to  the  nominal 
command  of  20  degrees.  The  support  leg  torques  are  required  to  be  slightly 
higher  in  this  case  in  order  to  maintain  the  higher  progression  velocity. 
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Figure  5.2  - Progression,  Known  level  grade,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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5.1.2  Progression:  Known  Inclined  Grade 

The  nominal  control  system  is  also  able  to  negotiate  inclined  surfaces  of 
various  grades.  Figures  5.3  though  5.6  depict  walking  up  and  down  inclined 
surfaces  with  plus  and  minus  10  degree  grade.  The  horizontal  and  vertical 
positions  of  the  swing  (free)  leg  tip  are  plotted  versus  time  at  the  top  of  each 
figure.  Also  shown  versus  time  are  the  five  joint  angles,  and  the  applied  joint 
torques.  At  the  bottom  of  each  figure,  the  swing  leg  tip  trajectory  is  plotted  as 
well  as  the  gait  visualization  diagram.  Once  again  the  switching  discontinuities 
are  visible  when  viewed  with  respect  to  time.  Unlike  the  previous  cases  (zero 
grade),  switching  discontinuities  are  now  also  visible  in  the  swing  leg  tip  vertical 
position.  This  is  as  expected  since  both  horizontal  and  vertical  positions  change 
when  support  is  exchanged  on  a non-level  grade. 

Figure  5.3  demonstrates  a -i-IO  degree  grade  progression  at  0.2 
meter/second,  a step  length  of  0.17  meters,  and  a step  height  of  1 .7  centimeters. 
As  before,  the  stance  knee  bias  is  commanded  to  20.0  degrees,  and  posture 
angle  to  -3.8  degrees.  Unlike  the  level  grade  cases,  the  hip  fraction  is 
commanded  to  0.1 . This  low  level  of  hip  fraction  tends  to  distribute  the  biped 
mass  more  directly  over  the  downhill  foot.  The  tip,  knee,  and  posture  phase 
coefficients  are  again  0.006,  0.0027,  and  -0.018  respectively.  The  commanded 
progression  velocity  is  ramped  from  zero  to  0.2  m/sec  over  the  first  two  seconds 
of  the  simulation  run.  The  figure  shows  a smooth,  stable  progression  is 
established  after  four  or  five  gait  cycles.  The  stance  knee  bias  (6^ ) shows 
relatively  large  variation  from  the  commanded  level.  This  is  due  to  the  fact  that 
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Figure  5.3  - Progression,  Known  +10  Degree  Grade,  0.2  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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upon  contact  with  the  walking  surface,  the  swing  leg  knee  angle  (67)  is 

significantly  larger  than  the  support  leg  knee  angle.  After  switching,  there  exists  a 
large  difference  between  the  actual  and  commanded  stance  knee  bias.  The 
difference  is  smoothly  eliminated  due  in  part  to  the  “elementary  trajectory” 
algorithm  described  in  Appendix  D.  This  large  knee  bias  variation  is  indicative  of 
any  gait  on  a non-zero  grade,  or  with  an  unbalanced  hip  fraction. 

Figure  5.4  demonstrates  a +10  degree  grade  progression  at  0.8 
meter/second,  a step  length  of  0.46  meters,  and  a step  height  of  4.6  centimeters. 
As  before,  the  stance  knee  bias  is  commanded  to  20.0  degrees,  and  posture 
angle  to  0.75  degrees.  This  time  the  hip  fraction  is  commanded  to  0.35.  The  tip, 
knee,  and  posture  phase  coefficients  are  -0.077,  0.03,  and  -0.049  respectively. 
The  commanded  progression  velocity  is  again  ramped  over  the  first  two  seconds 
of  the  simulation  run.  The  figure  shows  a smooth,  stable  progression  is 
established  after  three  or  four  gait  cycles. 

Figure  5.5  demonstrates  a -10  degree  grade  progression  at  0.2 
meter/second,  a step  length  of  0.17  meters,  and  a step  height  of  1.7  centimeters. 
This  time  the  stance  knee  bias  is  commanded  to  37.5  degrees,  and  posture 
angle  to  -3.8  degrees.  Unlike  the  previous  cases,  the  hip  fraction  is  commanded 
to  0.9.  With  the  negative  grade,  this  high-level  of  hip  fraction  tends  as  before  to 
distribute  the  biped  mass  more  directly  over  the  downhill  foot.  The  tip,  knee,  and 
posture  phase  coefficients  are  again  0.006,  0.0027,  and  -0.018  respectively. 

The  commanded  progression  velocity  is  ramped  from  zero  to  0.2  m/sec  over  the 
first  two  seconds  of  the  simulation  run.  The  figure  shows  a smooth,  stable 
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Figure  5.4  - Progression,  Known  +10  Degree  Grade,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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Figure  5.5  - Progression,  Known  -10  Degree  Grade,  0.2  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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progression  is  established  after  four  or  five  gait  cycles.  The  stance  knee  bias 
shows  the  large  variation  indicative  of  gait  on  a non-zero  grade.  The  stance  knee 
variation  is  now  in  the  negative  direction  since  upon  contact  with  the  walking 
surface  the  swing  leg  knee  angle  (67)  is  significantly  smaller  than  the  support  leg 
knee  angle. 

Figure  5.6  demonstrates  a -10  degree  grade  progression  at  0.8 
meter/second,  a step  length  of  0.46  meters,  and  a step  height  of  4.6  centimeters. 
The  stance  knee  bias  is  commanded  to  57.0  degrees,  and  posture  angle  to  0.75 
degrees.  This  time  the  hip  fraction  is  commanded  to  0.65.  The  tip,  knee,  and 
posture  phase  coefficients  are  -0.077,  0.03,  and  -0.049  respectively.  The 
commanded  progression  velocity  is  again  ramped  over  the  first  two  seconds  of 
the  simulation  run.  The  figure  shows  a smooth,  stable  progression  is  established 
after  three  or  four  gait  cycles. 

The  joint  torque  magnitudes  during  progression  over  non-level  grades,  are 
not  significantly  different  from  those  of  level  grade  progression.  The  support 
ankle  torques  are  slightly  higher  during  the  transition  between  level  and  positive 
grades. 

5.1.3  Progression:  Unknown  Varying  Grade 

We  have  demonstrated  the  ability  to  negotiate  various  known  ground 
profiles  at  various  speeds.  The  ground  profile  information  may  be  obtained  via 
any  one  of  a number  of  robot  mountable  ultrasonic  or  laser  range-sensing 
devices.  See  Kajita  and  Tani  [5].  The  resolution  of  the  range  signal  may  dictate 
the  need  for  a degree  of  robustness  in  the  robot  control  system  with  respect  to 
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Figure  5.6  - Progression,  Known  -10  Degree  Grade,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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ground  profile.  Our  nominal  control  algorithm  is  capable  of  traversing  ground  of 
varying  profile  with  no  a priori  knowledge  of  the  variation.  Figure  5.7 
demonstrates  an  unknown  and  varying  grade  progression  at  0.8  meter/second. 
The  horizontal  and  vertical  positions  of  the  swing  (free)  leg  tip  are  plotted  versus 
time  at  the  top  of  the  figure.  Also  shown  versus  time  are  the  five  joint  angles,  and 
the  applied  joint  torques.  At  the  bottom  of  the  figure,  the  swing  leg  tip  trajectory  is 
plotted  as  well  as  the  gait  visualization  diagram.  The  ground  profile  was 
randomly  generated  within  a band  of  +/-  2.5  centimeters  in  height,  and  can  be 
seen  in  Figure  5.7m.  The  separation  of  the  profile  variations  has  been  carefully 
chosen  to  avoid  tangential  contact  as  tripping  is  the  subject  of  subsequent 
sections.  Although  varying,  the  ground  is  assumed  to  be  stable  and  sufficiently 
rough  to  avoid  slipping.  The  control  has  no  a priori  knowledge  of  the  surface 
variation.  The  gait  parameters  were  chosen  by  the  control  system  assuming  a 
level  grade.  The  step  length  is  0.46  meters,  step  height  is  4.6  centimeters.  The 
stance  knee  bias  is  commanded  to  20.0  degrees,  posture  angle  to  0.75  degrees, 
and  hip  fraction  to  0.5.  The  tip,  knee,  and  posture  phase  coefficients  are  -0.077, 
0.03,  and  -0.049  respectively.  The  figure  shows  stable  progression  is 
established  despite  the  ground  profile  variation.  The  control  maintains  a nearly 
constant  progression  velocity  despite  the  roughness  of  the  terrain.  As  a result, 
the  support  knee  and  ankle  torques  are  necessarily  higher  when  stepping  up  as 
opposed  to  down. 
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Figure  5.7  - Progression,  Unknown  varying  grade,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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5.1.4  Double  Support 

Figure  5.8  demonstrates  the  ability  to  manipulate  the  biped  configuration 
while  in  double  support  (standing)  phase.  The  vertical  ground  reaction  forces 
under  the  support  and  swing  legs  are  plotted  in  5.8a  and  5.8b  respectively.  Also 
displayed  are  the  five  joint  angles,  and  the  applied  joint  torques  versus  time.  At 
the  bottom  of  the  figure,  the  commanded  and  resultant  hip  fraction  are  plotted 
versus  time  as  well  as  the  gait  visualization  diagram.  The  hip  fraction  is 
commanded  to  vary  between  0.3  and  0.8.  The  effect  of  this  is  seen  in  the  vertical 
ground  reaction  forces  under  the  swing  and  support  legs  as  shown.  This  case 
illustrates  a subtle  aspect  of  the  standing  gait  synthesis  algorithm.  The  leg  tip 
separation  and  hip  fraction  together  dictate  a minimum  value  of  the  stance  knee 
bias  which  is  required  to  keep  the  swing  leg  knee  away  from  it’s  singularity 
(07=0).  As  shown  in  the  figure  stance  knee  bias  (ej  is  increased  as  hip  fraction 

is  reduced  below  0.5.  In  this  case,  this  is  done  in  such  a way  as  to  maintain  the 
swing  leg  knee  bias  to  15.0  degrees.  Note  that  the  applied  joint  torques  are 
significantly  less  than  those  required  during  progression.  This  is  expected  since 
biped  performs  less  work. 

5.1.5  Phase  Plane  Portraits 

Phase  plane  portraits  are  a common  tool  for  analyzing  the  dynamics  and 
stability  of  nonlinear  systems.  A phase  plane  portrait  shows  a system  variable’s 
velocity  versus  position.  An  n-state  2"^  order  system’s  entire  state  space  may  be 
viewed  with  n portraits.  Analysis  in  the  phase  plane  will  often  reveal 
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Figure  5.8  - Standing,  Hip  Fraction  Adjustment 
a)  Support  leg  normal  ground  reaction  force;  b)  Swing  leg  normal  ground 
reaction  force;  c)  Support  ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee 
angle;  f)  Support  knee  torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i) 
Swing  hip  angle;  j)  Swing  hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque; 

m)  Hip  fraction;  n)  Gait  diagram 
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characteristics  of  the  underlying  dynamics  that  are  not  obvious  in  the  time 
domain.  Phase  plane  analysis  of  gait  cycles  that  suffer  large  magnitude 
disturbances  may  provide  insight  into  potential  compensation.  In  this  section  we 
present  the  phase  plane  portraits  for  two  previously  demonstrated  gait  cycles. 
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Figure  5.9  - Phase  Plane  Portrait,  Level  Grade,  0.8  m/sec 
a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 
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Figure  5.9  contains  the  five  phase  plane  portraits  for  the  level  grade 
progression  depicted  previously  in  Figure  5.2.  The  portraits  show  a stable  limit 
cycle  is  achieved  after  the  first  step.  The  phase  portraits  for  the  five-link  biped 
are  complicated  somewhat  by  the  presence  of  the  switching  discontinuity.  For 
clarification,  several  points  in  the  cycle  have  been  marked  and  numbered.  The 
locomotion  begins  from  a double  support  (standing)  mode  in  which  all  the  joint 
angular  velocities  are  zero  (point  ‘0’).  Progression  begins  and  the  state 
trajectories  can  be  traced  from  point  ‘0’  to  the  initial  ground  contact  at  point  ‘1’. 
There  is  a discontinuity  in  angular  velocities  following  the  application  of  the 
impulsive  forces  due  to  impact  (point  ‘2’).  Immediately  following  the  impact,  the 
switching  algorithm  is  invoked  to  exchange  the  roles  of  the  support  and  swing 
legs  causing  the  shift  to  point  ‘3’.  The  subsequent  step  is  depicted  by  the  state 
trajectories  from  point  ‘3’  back  to  point  ‘1’.  A stable  limit  cycle  follows  with  only 
slight  variation  in  the  state  trajectories. 

Figure  5.1 0 contains  the  five  phase  plane  portraits  for  the  -1 0 degree 
grade  progression  depicted  previously  in  Figure  5.6.  The  portraits  show  a stable 
limit  cycle  is  achieved  after  the  fourth  step.  The  locomotion  begins  from  a double 
support  (standing)  mode  in  which  all  the  joint  angular  velocities  are  zero  (point 
‘0’).  Progression  proceeds  through  three  step  cycles  which  include  contact, 
impact,  and  switching  before  contact  is  again  made  at  point  ‘1’.  The  shift  from 
point  ‘1’  to  point  ‘2’  represents  the  discontinuity  in  angular  velocities  due  to  the 
impact.  Immediately  following  the  impact,  the  switching  algorithm  is  invoked  to 
exchange  the  roles  of  the  support  and  swing  legs  causing  the  shift  to  point  ‘3’. 
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The  subsequent  step  is  depicted  by  the  state  trajectories  from  point  ‘3’  back  to 
point  ‘1’.  A stable  limit  cycle  is  thus  achieved  with  all  subsequent  steps  traversing 
the  same  path  between  points  ‘T,  ‘2’,  and  ‘3’. 


(a)  (b) 


(c)  (d) 


(e) 


Figure  5.10  - Phase  Plane  Portrait,  -10  Degree  Grade,  0.8  m/sec 
a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 
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Phase  plane  portraits  for  the  other  conditions  have  been  omitted  for 
brevity.  Their  structure  is  similar  to  those  presented.  In  all  evaluation  test  cases, 
the  state  trajectories  converge  to  stable  limit  cycles  that  correspond  to  steady 
progression. 


5.2  Susceptibility  to  Slipping 

To  be  successful  a bipedal  locomotion  system  will  be  required  to  robustly 
traverse  terrain  with  unknown  and  varying  surface  conditions.  Even  in  made-for- 
human  environments  a broad  range  of  surface  conditions  may  be  encountered 
where  slipping  is  likely.  What  is  normally  a well  conditioned  surface  can  become 
slippery  with  a slight  amount  of  oil  or  liquid.  Loose  terrain  such  as  a small 
amount  of  sand  on  a smooth  surface  represents  a serious  slipping  hazard.  It  is 
not  practical  to  assume  the  level  of  sensor  sophistication  that  would  be  required 
for  a priori  detection  and  avoidance  of  potentially  slippery  surfaces.  A truly  robust 
system  must  have  the  capability  to  recover  from  slipping.  Our  investigation  of 
slipping  is  restricted  to  level  grade  surfaces. 

During  the  progression  phase  of  locomotion,  the  configuration,  velocity, 
and  weight  of  the  biped  couple  with  the  joint  actuator  torques  to  create  a ground 
reaction  force  vector  beneath  the  support  foot.  This  force  vector  will  have  a 
component  that  is  normal  to  the  surface  (F^),  and  one  that  is  tangential  to  the 

surface  (Ft).  Slipping  occurs  when  the  tangential  component  exceeds  the 
normal  component  times  the  coefficient  of  static  friction.  Once  slipping  occurs, 
the  tangential  component  will  have  a maximum  value  given  by  the  vertical 
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component  times  the  coefficient  of  dynamic  friction.  The  ratio  of  tangential  and 
normal  ground  reaction  forces  is  likely  to  be  largest  at  the  beginning  and  ending 
of  a step  when  the  biped  center  of  mass  is  furthest  from  the  contact  point.  The 
motion  of  the  biped  prior  to  contacting  the  surface  and  the  applied  hip,  knee,  and 
ankle  torques  immediately  following  contact  will  make  slipping  most  likely  at  the 
beginning  of  the  step.  Unfortunately  the  beginning  of  the  step  is  also  the  most 
critical  in  terms  counteracting  the  effects  of  the  contact  event  and  establishing 
the  desired  trajectories  for  the  subsequent  step. 

The  susceptibility  of  the  biped  robot  to  slipping  is  demonstrated  in  Figures 
5.1 1 and  5.12.  In  each  case  a standard  gait  is  established  at  the  desired 
progression  velocity  over  a level  grade.  At  a pre-determined  horizontal  distance 
from  the  origin  the  surface  coefficient  of  friction  is  dramatically  reduced.  The 
level  and  location  of  the  friction  coefficient  change  are  unknown  to  the  robot 
control  system.  This  dramatic  change  in  friction  coefficient  is  typical  of  what  the 
robot  would  encounter  stepping  onto  very  loose  terrain  or  onto  a slippery  surface 
such  as  an  oil  spill.  The  horizontal  and  vertical  positions  of  the  swing  (free)  leg  tip 
are  plotted  versus  time  at  the  top  of  each  figure.  Also  shown  versus  time  are  the 
five  joint  angles,  and  the  applied  joint  torques.  At  the  bottom  of  each  figure,  the 
swing  leg  tip  trajectory  is  plotted  as  well  as  the  gait  visualization  diagram. 

Figure  5.1 1 shows  the  biped  walking  on  a level  grade  surface  with  a 
progression  velocity  of  0.2  m/sec.  The  surface  friction  coefficient  is  reduced  to  a 
value  of  0.075  at  a point  approximately  0.9  meters  from  the  origin.  The  planning 
parameters  are  identical  to  those  in  Figure  5.1 . The  output  shows  several 
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Figure  5.1 1 - Progression  and  slipping,  0.2  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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successful  steps  before  encountering  the  region  with  reduced  coefficient  of 
friction.  The  subsequent  step  slips  immediately  and  with  no  active  slip  recovery 
algorithm,  the  robot  falls.  The  slipping  foot  leaves  the  ground  almost 
immediately.  The  model  based  tracking  control  continues  the  effort  to  track  the 
desired  trajectories  with  no  knowledge  of  the  support  foot  slip  and/or  loss  of 
contact.  Since  these  torque  computations  pre-suppose  a base  of  support  the 
resulting  torques  are  grossly  incorrect  and  the  joint  tracking  errors  rapidly 
balloon. 

Figure  5.12  shows  the  biped  walking  on  a level  grade  surface  with  a 
progression  velocity  of  0.8  m/sec.  The  surface  friction  coefficient  is  reduced  to  a 
value  of  0.37  at  a point  approximately  3.5  meters  from  the  origin.  The  planning 
parameters  are  identical  to  those  in  Figure  5.2.  The  results  are  similar  to  those  of 
Figure  5. 11  except  the  departure  is  somewhat  quicker  here  due  to  the  higher 
system  velocities.  The  robot  slips,  the  subsequent  control  action  aggravates  the 
situation,  contact  is  lost  and  the  robot  falls. 

It  is  clear  from  the  above  analysis  that  the  robot  is  susceptible  to  loss  of 
stability  due  to  slipping.  We  observe  that  without  compensation  the  model  based 
tracking  control  algorithm  virtually  assures  the  robot  will  fall  since  the  torque 
computations  pre-suppose  a base  of  support.  Therefore  a high  bandwidth 
tracking  control  will  actually  result  in  a quicker  loss  of  stability.  The  time  available 
to  react  to  the  slipping  event  will  have  an  inverse  relationship  to  the  bandwidth  of 
the  tracking  control. 
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Figure  5.12  - Progression  and  slipping,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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5.2.1  Phase  Plane  Portraits 

Figure  5.13  contains  the  five  phase  plane  portraits  for  the  progression  and 
slipping  depicted  in  Figure  5.12.  The  portraits  are  very  similar  to  the  level  grade 
phase  plane  portraits  previously  shown.  Once  again,  the  locomotion  begins  from 


(a)  (b) 
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Figure  5.13  - Phase  Plane  Portrait,  Progression  and  Slipping,  0.8m/sec 
a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 
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a double  support  (standing)  mode  in  which  all  the  joint  angular  velocities  are  zero 
(point  ‘0’).  As  usual  a stable  limit  cycle  is  established  between  points  ‘1’,  ‘2’,  and 
‘3’.  The  state  trajectories  deviate  from  this  limit  cycle  after  first  contact  with  the 
slippery  surface.  The  impulsive  forces  resulting  from  the  slipping  impact  solution 
result  in  slightly  different  joint  angular  velocities  that  appear  amplified  after 
switching  (point  ‘4’).  The  state  trajectories  from  this  point  forward  represent  the 
remainder  of  the  locomotion  until  contact  is  completely  lost.  The  largest  phase 
plane  oscillations  occur  in  the  support  leg  ankle  ( 0, ) and  knee  joints  ( 64 ) as 

shown  in  Figures  5.13a  and  5.13b.  The  swing  leg  trajectories  diverge  from  the 
target  limit  cycle  but  at  a much  slower  rate. 

5.2.2  Slip  Boundary 

We  previously  noted  that  slipping  will  occur  when  the  tangential 
component  of  the  ground  reaction  force  exceeds  the  normal  component  times 
the  coefficient  of  static  friction  (F,,  >|i  • ).  The  maximum  value  of  the  ground 

reaction  force  ratio  (F^^/F^  ) is  equivalent  to  the  minimum  value  of  surface  friction 

coefficient  required  to  avoid  slipping.  The  ground  reaction  forces  are  dictated  by 
the  system  state  (positions  and  velocities)  and  the  applied  joint  torques.  They  are 
therefore  the  direct  result  of  the  established  gait  parameters,  and  the  tracking 
control.  Since  our  sub-optimal  gait  parameters  vary  with  progression  velocity,  the 
maximum  ground  reaction  force  ratio  will  be  a function  of  progression  velocity. 
Figure  5.14  shows  the  minimum  surface  friction  coefficient  that  is  required  to 
avoid  slipping  during  progression  on  a level  grade  surface.  These  values  were 
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obtained  by  calculating  the  maximum  value  of  the  ground  reaction  force  ratio 
achieved  during  normal  progression.  This  data  depends  upon  the  gait  synthesis 
algorithm,  the  selected  gait  parameters,  and  the  tracking  control  algorithm.  At 
any  given  progression  velocity,  any  other  combination  of  gait  parameters  may 
increase  or  decrease  the  required  friction  coefficient.  The  gait  parameters  used 
were  those  optimized  for  control  power,  not  slip  prevention. 


Figure  5.14  - Minimum  Friction  Coefficient  Required  to  Avoid  Slipping 


5.3  Susceptibility  to  Tripping 

In  section  5.1.3  we  discussed  the  use  of  any  one  of  a number  of  robot 
mountable  ultrasonic  or  laser  range-sensing  devices  to  obtain  ground  profile 
information.  The  resolution  of  the  range  signal  may  be  such  that  small  obstacles 
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or  slight  changes  in  the  ground  profile  would  be  overlooked.  Even  a highly 
accurate  sensor  could  not  be  reasonably  expected  to  completely  map  the  three 
dimensional  ground  profile  in  real-time.  Moreover  even  if  small  obstacles  are 
detected,  the  robot’s  ability  to  avoid  them  will  depend  on  the  progression  velocity 
and  step  phase.  Section  5.1 .3  demonstrates  the  ability  of  the  robot  control 
system  to  accommodate  unexpected  changes  in  surface  grade  when  contact  is 
normal  (i.e.,  the  robot  steps  down  on  the  object)  and  occurs  near  the  end  of  the 
step  cycle.  In  this  section  we  assess  the  ability  of  the  robot  to  sustain 
unexpected  tangential  contact  with  an  obstacle  at  any  point  in  the  gait  cycle.  The 
terms  ‘normal’  and  ‘tangential’  refer  to  the  slope  of  the  obstacle  surface  relative 
to  the  fixed  coordinate  frame  as  depicted  in  Figure  5.15.  It  is  of  course  possible 
to  make  contact  with  an  irregularly  shaped  obstacle  at  nearly  any  angle  of 
incidence.  A well-instrumented  foot  would  have  the  ability  to  distinguish  between 
various  contact  surface  slopes.  A threshold  may  be  defined  below  which  the 
robot  will  step  onto  the  obstacle  and  above  which  tripping  is  declared.  For  the 
purposes  of  this  research  we  restrict  our  investigation  to  surface  contact  that  is 
purely  normal  or  tangential. 


(a)  (b) 


Figure  5.15  - Obstacle  Contact 
a)  Normal  contact;  b)  Tangential  contact 
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Tangential  ground  contact  may  occur  in  any  of  three  distinct  regions  of  the 
gait  cycle.  Figure  5.16  depicts  a representative  swing  leg  tip  trajectory  and  the 
three  trip  regions  of  the  gait  cycle.  Region  T is  positioned  near  the  end  of  the 
gait  cycle  as  the  foot  approaches  the  ground.  In  this  region  the  robot  is 
somewhat  committed  to  the  target  foothold.  The  center  of  mass  has  moved 
forward  of  the  support  foot  and  significant  trajectory  adjustments  will  require 
significant  control  energy.  Region  ‘IV  occurs  in  the  middle  of  the  gait  cycle  but 
after  the  swing  foot  passes  over  the  support  foot.  The  robot  is  not  seriously 
committed  to  the  target  touchdown  location.  The  center  of  mass  is  generally 
above  the  support  foot  and  any  significant  trajectory  adjustments  are  still 
possible.  Region  ‘IIT  occurs  near  the  beginning  of  the  gait  cycle.  The  control 
system  is  establishing  the  current  step  and  there  is  more  time  to  recover  should 
contact  occur.  There  is  a region  of  the  two-dimensional  gait  cycle  where  contact 
will  not  occur.  Contact  will  not  occur  in  the  area  between  regions  ‘IT  and  ‘m’ 
since  the  previous  step  would  have  made  a region  ‘I’  contact.  Contact  is  possible 
in  this  area  under  a three  dimensional  model  only.  In  the  three-dimensional 
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Figure  5.16  - Trip  Regions  of  the  Gait  Cycle 


81 


model,  this  area  would  be  treated  as  part  of  region  ‘III’  since  contact  here  would 
require  similar  action  during  subsequent  steps. 

Investigation  of  tripping  was  performed  over  a wide  range  of  progression 
velocities  and  obstacle  locations.  The  biped  performance  was  consistent  across 
the  range  of  progression  velocities  and  within  contact  regions.  To  demonstrate 
we  now  review  the  results  of  tripping  in  each  of  the  three  regions  at  a single 
progression  velocity. 

Figures  5.17  through  5.19  demonstrate  unexpected  tangential  ground 
contact  in  each  of  the  three  regions.  In  all  three  cases  a standard  sub-optimal 
gait  is  established  on  level  grade  at  a progression  velocity  of  0.8  m/sec.  At  a pre- 
determined horizontal  distance  from  the  origin  the  ground  profile  is  altered  to 
simulate  an  obstacle.  The  obstacles  were  chosen  to  be  of  equal  height  and 
width,  and  are  assumed  to  be  rigidly  attached  to  the  surface.  The  height  and 
location  of  the  obstacles  are  unknown  to  the  robot  control  system.  The  horizontal 
and  vertical  positions  of  the  swing  (free)  leg  tip  are  plotted  versus  time  at  the  top 
of  each  figure.  Also  shown  versus  time  are  the  five  joint  angles,  and  the  applied 
joint  torques.  At  the  bottom  of  each  figure,  the  swing  leg  tip  trajectory  is  plotted 
as  well  as  the  gait  visualization  diagram. 

Figure  5.17  demonstrates  unexpected  tangential  ground  contact  in  region 
T of  the  gait  cycle.  The  swing  leg  tip  encounters  a 6 centimeter  square  object  at 
a point  approximately  2.7  meters  from  the  origin.  Impact  occurs  at  approximately 
85%  of  the  step  cycle.  With  no  active  trip  recovery  algorithm,  the  robot  continues 
to  close  loop  on  the  steady  progression  target  trajectories.  Attempting  to  track 
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Figure  5.17  - Progression  and  tripping,  Region  I,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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the  swing  knee  target  trajectory  causes  the  lower  portion  of  the  swing  leg  to  be 
dragged  up  the  front  side  and  along  the  top  of  the  obstacle.  Concurrently  the 
remaining  trajectories  are  tracked  well  past  the  time  the  swing  leg  was  expected 
to  make  surface  contact.  Once  clear  of  the  obstacle  the  swing  leg  tip  is  brought 
quickly  to  the  surface.  Contact  is  made  and  switching  occurs  but  by  this  time  the 
robot  is  over  extended.  The  support  leg  slips  on  the  surface  and  contact  is  lost. 
Both  lower  legs  are  kicked  backward  as  the  robot  torso  falls  forward.  The  top  of 
Figure  5.17m  shows  the  leg  tip  trajectories’  departure. 

Figure  5.18  demonstrates  unexpected  tangential  ground  contact  in  region 
‘IT  of  the  gait  cycle.  The  swing  leg  tip  encounters  a 6-centimeter  square  object  at 
a point  approximately  2.4  meters  from  the  origin.  Impact  occurs  at  approximately 
55%  of  the  step  cycle.  Once  again  the  lower  portion  of  the  swing  leg  is  dragged 
up  the  front  side  of  the  obstacle.  Once  clear  of  the  obstacle,  there  is  sufficient 
time  to  re-capture  the  target  trajectory  and  contact  the  surface  very  near  the 
target  touchdown  point  and  switching  occurs.  With  no  active  trip  recovery 
algorithm,  the  robot  continues  to  follow  the  steady  progression  target  trajectories. 
Very  quickly  the  rear  leg  tip  impacts  the  same  obstacle.  The  rear  foot  is  now 
dragged  up  the  front  side  of  the  obstacle.  As  before  there  is  sufficient  time  to  re- 
capture the  target  trajectory  and  contact  the  surface  very  near  the  target 
foothold.  In  this  case  the  nominal  control  algorithm  recovers  from  the  tripping 
event  but  only  after  unnecessarily  making  a second  contact  with  the  obstacle. 

Figure  5.19  demonstrates  unexpected  tangential  ground  contact  in  region 
‘nr  of  the  gait  cycle.  The  swing  leg  tip  encounters  a 4-centimeter  square  object 
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Figure  5.18  - Progression  and  tripping,  Region  n,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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Figure  5.19  - Progression  and  tripping,  Region  HI,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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at  a point  approximately  2.5  meters  from  the  origin.  Impact  occurs  at 
approximately  15%  of  the  step  cycle.  The  left  foot  had  cleared  the  obstacle 
without  contact  on  the  previous  step.  Once  again  the  lower  portion  of  the  swing 
leg  is  dragged  up  the  front  side  of  the  obstacle.  Once  clear  of  the  obstacle,  there 
is  sufficient  time  to  re-capture  the  target  trajectory  and  contact  the  surface  very 
near  the  target  touchdown  point  and  switching  occurs.  Since  the  robot  is  now 
completely  clear  of  the  obstacle  the  control  is  able  to  resume  steady  progression 
with  minimal  impact.  In  this  case  the  nominal  control  algorithm  adequately 
recovers  from  the  tripping  event. 

It  is  clear  the  robot  is  susceptible  to  loss  of  stability  due  to  tripping  when 
contact  occurs  in  region  T of  the  gait  cycle.  Although  contact  in  regions  TT  and 
‘nr  do  not  result  in  loss  of  stability,  they  do  represent  moderate  disruption  of  the 
planned  trajectories.  We  observe  that  subsequent  to  region  ‘IT  contact  the  rear 
foot  encountered  the  same  obstacle  unnecessarily.  We  conclude  that 
subsequent  step  obstacle  avoidance  will  be  a necessary  component  of  any 
tripping  compensation. 

5.3.1  Phase  Plane  Portraits 

Figure  5.20  contains  the  five  phase  plane  portraits  for  the  progression  and 
region  T tripping  depicted  in  Figure  5.17.  The  locomotion  begins  from  a double 
support  (standing)  mode  in  which  all  the  joint  angular  velocities  are  zero  (point 
‘0’).  Once  again,  a stable  limit  cycle  is  established  between  points  ‘T,  ‘2’,  and  ‘3’. 
The  state  trajectories  deviate  from  this  limit  cycle  after  first  contact  with  the 
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(a)  (b) 


Figure  5.20  - Phase  Plane  Portrait,  Progression  and  Tripping,  0.8m/sec 
a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 


obstacle  (point  ‘4’).  The  state  trajectories  following  the  initial  contact  correspond 
to  dragging  the  swing  leg  first  up  the  face  of  the  obstacle  and  then  along  the  top. 
Once  clear  of  the  obstacle,  the  tip  of  the  swing  leg  quickly  contacts  the  surface  at 
point  ‘5’.  Although  the  target  foothold  was  ultimately  achieved,  the  configuration 
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of  the  biped  at  that  time  was  over  extended.  The  over  extension  of  the  system  is 
most  visible  in  the  support  ankle  position  (0, ) in  Figure  5.20a.  The  shift  from 

point  ‘5’  to  point  ‘6’  represents  the  discontinuity  in  angular  velocities  due  to  the 
impact.  The  switching  algorithm  is  invoked  to  exchange  the  roles  of  the  support 
and  swing  legs  causing  the  shift  to  point  7’.  After  switching  the  tracking  control 
attempts  to  correct  the  large  state  trajectory  errors.  The  applied  torque  causes 
the  support  leg  to  slip  on  the  surface  and  ultimately  lose  contact.  The  remainder 
of  the  state  trajectories  represents  the  subsequent  loss  of  support. 


CHAPTER  6 
REFLEXIVE  CONTROL 


In  Chapter  5 we  demonstrated  the  susceptibility  of  the  robot  to  loss  of 
stability  due  to  slipping  and  tripping.  We  now  investigate  the  use  of  reflexes  to 
recover  from  these  types  of  ground  contact  errors. 

Most  ground  contact  errors  could  be  avoided  altogether  if  the  robot  could 
detect  and  avoid  surface  regions  with  undesirable  characteristics.  This  would 
require  an  unrealistic  level  of  sensor  sophistication.  Since  it  is  not  practical  to 
expect  a priori  detection  and  avoidance,  a robust  robot  control  system  must 
detect  and  respond  to  the  unexpected  event  after  it  has  occurred  and  before 
stability  is  lost.  In  many  cases  the  amount  of  time  available  for  detection  and 
recovery  is  extremely  limited.  Reflexes  provide  the  mechanism  by  which  a 
bipedal  locomotion  system  can  recover  from  ground  contact  errors  such  as 
slipping  or  tripping.  Only  pre-programmed  responses  (reflexes)  can  be  invoked 
quickly  enough  to  effectively  reject  the  very  rapid  slipping  and  tripping 
disturbances. 

Looking  at  the  structure  of  our  control  system  in  Figure  6.1  we  see  there 
are  three  levels  at  which  reflexes  or  feed  forward  commands  may  be  invoked. 
We  define  low-level  reflexes  as  direct  modification  of  the  joint  torque  commands. 
Medium  level  reflexes  include  modification  of  tracking  control  gains  and/or  direct 
modification  of  desired  joint  trajectories.  Modification  of  the  high-level  gait 
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Figure  6.1  - Levels  of  Possible  Reflexive  Control 


parameters  constitutes  a high-level  reflex  action.  We  note  that  there  are  certain 
advantages  and  disadvantages  to  the  various  reflex  levels.  The  lower-level 
reflexes  have  the  advantage  of  more  immediate  system  response  but  will  tend  to 
be  extremely  configuration  and  environment  dependent.  For  example, 
modification  of  joint  torques  will  affect  system  response  more  quickly  than 
modification  of  gait  parameters  since  the  tracking  control  dynamics  is  bypassed. 
However,  the  higher-level  gait  parameter  reflex  will  tend  to  be  more  generally 
applicable  to  a wide  variety  of  robot  configurations  (length,  mass,  inertia)  and 
environment  conditions  (coefficients  of  friction,  restitution).  Since  our  goal  is  to 
develop  reflexive  control  strategies  that  will  be  generally  applicable,  we  would 
like  to  avoid  the  lower-level  reflexes  if  at  all  possible. 

In  this  chapter  we  develop  the  reflexive  control  responses  to  slipping  and 
tripping.  In  each  case,  the  ground  contact  reflexes  are  smoothly  integrated  into 
the  nominal  control  system.  The  reflexive  control  system  is  then  evaluated  to 
demonstrate  the  improvements  in  ground  contact  disturbance  rejection. 
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6.1  Reflexive  Slipping  Control 

In  Chapter  5 we  demonstrated  the  susceptibility  of  the  bipedal  robot  to 
slipping  while  traversing  level  grade  terrain.  We  have  chosen  to  restrict  our 
investigation  of  slipping  to  level  grade  surfaces.  In  this  section  we  develop  a 
reflexive  response  strategy  to  improve  the  robustness  of  the  locomotion  system 
to  slipping.  We  first  address  the  subject  of  slip  detection  and  activation  of  the 
reflexive  response.  Reflexive  slip  recovery  strategies  are  proposed  and  smoothly 
integrated  into  the  existing  control  structure.  Finally,  the  effectiveness  of  the  slip 
recovery  algorithm  is  demonstrated. 

6.1 .1  Slip  Detection  / Reflex  Activation 

Slip  detection  may  be  performed  either  directly  via  a foot  mounted  slip 
sensor  or  indirectly  by  analysis  of  joint  angles  and  velocities.  Analysis  of  the  joint 
information  would  require  collection  of  joint  data  over  many  compute  cycles, 
thereby  consuming  valuable  reaction  time.  This  reason  alone  makes  the  slip 
sensor  a much  more  desirable  alternative.  Micro-slip  sensing  devices  are  readily 
available  and  relatively  inexpensive.  Slip  sensors  could  be  easily  incorporated 
into  the  mechanical  design  of  the  robot  foot.  For  the  purposes  of  our  study  it  is 
assumed  that  the  control  system  is  equipped  with  foot  mounted  slip  sensors. 
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Even  with  a highly  accurate  slip  sensor  one  can  reasonably  expect  to 
receive  an  occasional  false  detect.  In  practice  it  would  be  undesirable  to  falsely 
declare  a slip  or  to  declare  a slip  that  may  quickly  self  correct.  A false  declaration 
would  drive  the  control  system  unnecessarily  into  a slip  recovery  mode.  To  avoid 
this  potentially  costly  mistake,  a common  count-up/count-down  algorithm  has 
been  implemented.  When  a slip  condition  is  detected  a counter  is  incremented, 
when  no  slip  is  detected  the  counter  is  decremented.  The  counter  is  never 
reduced  below  zero.  The  counter  must  achieve  a pre-specified  threshold  before 
a slip  is  declared  and  recovery  initiated.  The  value  of  this  threshold  is  a trade-off 
between  a loss  of  valuable  reaction  time  (in  the  case  of  an  actual  slip)  and  the 
desire  to  avoid  false  detection  and  accommodation.  Figure  6.2  shows  the 
overview  of  the  high-level  planning  algorithm  with  reflexive  slipping  control 
included.  The  shading  denotes  modifications  to  the  nominal  algorithm.  The  slip 


Figure  6.2  - Overview  of  High-Level  Planning  (Reflexive) 
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detection  algorithm  processes  sensor  information  using  the  count-up/count-down 
algorithm  to  declare  the  existence  of  a slipping  condition.  The  phase  selector 
algorithm  is  modified  to  create  a new  locomotion  phase  called  the  ‘slip  reflex’. 
Figure  6.3  depicts  the  new  state  diagram.  The  slip  reflex  phase  is  initiated  by  the 
slip  condition  declaration.  Initiation  of  this  new  locomotion  phase  represents  the 
primary  high-level  reflex. 


Figure  6.3  - Phase  Selector  State  Diagram  (Reflexive) 

6.1.2  Slip  Recovery  Strategies 

By  the  time  we  activate  the  slip  reflex,  the  robot  system  has  undergone 
several  compute  cycles  with  the  foot  slipping.  During  this  period  before  slip 
detection  the  tracking  control  will  be  generating  joint  torques  which  are  incorrect 
since  it  assumes  a fixed  base.  The  degree  to  which  the  torques  are  incorrect  is 
strongly  dependent  on  the  speed  of  the  robot,  it’s  mass  and  inertia,  and  the 
desired  gait  which  is  driving  the  torque  commands.  Once  the  slip  reflex 
locomotion  phase  is  activated  a set  of  reflexive  responses  must  be  quickly 
generated  to  counteract  the  destabilizing  effects  of  the  slip  before  control  is  lost 


and  the  robot  falls. 
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Two  fundamentally  distinct  slip  recovery  approaches  were  considered 
which  we  term  ‘same  step  slip-stop’,  and  ‘rear  foot  re-plant’.  The  slip-stop 
approach  attempts  to  halt  the  relative  motion  between  the  slipping  foot  and  the 
ground.  Once  the  slipping  is  eliminated  the  robot  would  continue  the  current  step 
with  modified  ‘slip  prevention’  gait  parameters.  The  re-plant  approach  abandons 
the  current  step  and  attempts  to  re-plant  the  rear  foot  as  quickly  as  possible.  The 
robot  may  then  stabilize  in  double  support  (standing)  mode  before  initiating 
subsequent  steps  with  modified  ‘slip  prevention’  gait  parameters. 

The  slip-stop  strategy  hinges  on  our  ability  to  halt  the  relative  motion 
between  the  slipping  foot  and  the  ground.  This  requires  choosing  reflexes  which 
reduce  the  tangential  component  and/or  increase  the  normal  component  of  the 
ground  reaction  force  vector.  Preliminary  investigation  has  shown  that  (just  after 
impact)  the  tangential  reaction  force  is  proportional  to  the  applied  ankle  torque. 
Since  ankle  torque  relates  directly  to  progression  velocity,  reasonable  reflexes 
may  include  a feed  forward  ankle  torque,  or  a reduction  in  progression  velocity. 
Depending  on  the  robot  configuration  the  applied  support  leg  hip  torque  may 
have  a significant  effect  on  the  normal  component  of  the  ground  reaction  force. 
Another  reasonable  reflex  may  include  a feed-forward  support  leg  hip  torque. 

Preliminary  studies  have  shown  the  slip-stop  approach  is  extremely 
difficult  to  perform  using  higher  level  reflexes.  In  cases  where  the  slip-stop 
approach  was  successfully  implemented  the  solution  relied  heavily  on  low-level 
reflexes  (feed  forward  torque  commands).  This  low-level  reflex  control 
implementation  was  not  robust  to  variations  in  surface  friction,  robot  size,  or 


95 


speed.  The  higher-level  reflexes  fail,  under  the  slip-stop  strategy,  because  they 
depend  strongly  on  the  fixed  base  serial  chain  assumption  built  into  the  tracking 
control. 

Phase  plane  analysis  of  the  slipping  condition  reveals  that  although  the 
state  trajectory  oscillations  are  large  for  the  support  leg  joints,  the  swing  leg 
control  loops  remain  relatively  stable.  This  phenomena  is  attributed  to  the 
relatively  large  inertia  of  the  torso.  When  the  support  leg  slips  and  support  is  lost, 
the  applied  joint  torques  will  drive  the  links  relative  to  the  much  larger  torso  rather 
than  the  contact  point,  essentially  making  the  torso  ‘ground’.  With  the  exception 
of  the  torso  position  and  velocity  error,  the  computed  torque  control  parameters 
used  to  calculate  the  swing  leg  torques  in  the  no-slip  condition  are  very  similar  to 
those  required  during  the  slipping  condition.  As  a result  the  re-plant  technique  is 
far  more  likely  to  achieve  success  with  higher  level  reflexes.  The  slip-stop 
approach  was  abandoned  to  pursue  the  potentially  more  robust  solution. 

The  rear  foot  re-plant  approach  to  slip  recovery  has  been  successfully 
achieved  with  a number  of  high  and  medium  level  reflexes.  The  chosen 
formulation  of  the  gait  synthesis  algorithm  allows  seamless  integration  of 
necessary  slip  recovery  reflexes.  The  rear  foot  re-plant  approach  seeks  to  halt 
the  forward  progression  of  the  biped  while  re-planting  the  rear  foot.  The  goal 
directed  nature  of  the  gait  synthesis  algorithm  allows  us  to  select  gait  parameter 
adjustments  (high-level  reflexes)  which  drive  the  progression  velocity  to  zero 
while  directing  the  swing  leg  to  the  ground  as  quickly  as  possible.  Since  the 
support  leg  control  torques,  generated  during  the  slipping  event,  are  particularly 
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erroneous,  these  loops  often  become  unstable  resulting  in  position  oscillation.  To 
maintain  stability,  the  tracking  control  bandwidth  is  reduced  for  the  support  leg 
ankle  and  knee  loops  (a  medium-level  reflex). 

Once  the  swing  leg  makes  contact  with  the  ground  the  phase  selector 
algorithm  transitions  the  locomotion  phase  from  ‘slip  reflex’  to  ‘stopping’.  Once  in 
the  stopping  phase  the  biped  is  stabilized  and  the  motion  of  the  previously 
slipping  foot  is  arrested.  When  double  support  is  achieved  the  locomotion  phase 
switches  through  standing  to  starting.  At  this  point  the  gait  parameter  selection 
algorithm  is  notified  of  the  slippery  surface  and  a modified  set  of  ‘slip  prevention’ 
gait  parameters  are  chosen  for  subsequent  motion. 

6.1.3  Effectiveness  of  Reflexive  Slipping  Control 

The  effectiveness  of  the  reflexive  control  system  is  now  demonstrated  in 
Figures  6.4  and  6.5.  The  scenarios  presented  are  identical  to  those  that  were 
previously  shown  to  defeat  the  nominal  control  algorithm  (Figures  5.9  and  5.10). 
The  horizontal  and  vertical  positions  of  the  swing  leg  tip  are  plotted  versus  time 
at  the  top  of  each  figure.  Also  displayed  are  the  five  joint  angles  and  applied  joint 
torques.  The  bottom  of  each  figure  contains  the  swing  leg  tip  vertical  position 
plotted  versus  the  horizontal  position,  as  well  as  a gait  visualization  diagram. 

Figure  6.4  shows  the  biped  walking  on  a level  grade  surface  with  a 
progression  velocity  of  0.2  m/sec.  The  gait  parameters  are  identical  to  those  in 
Figure  5.11 . The  output  shows  several  successful  steps  before  encountering  the 
region  with  reduced  coefficient  of  friction  (0.075).  When  the  leading  foot  makes 


97 


contact  with  the  slippery  surface  it  immediately  slips.  Four  0.005-second 
compute  cycles  occur  before  the  false  detection  prevention  logic  is  cleared  and 
the  slip-reflex  logic  is  activated.  The  commanded  progression  velocity  is 
immediately  zeroed  and  the  support  leg  loop  bandwidths  are  reduced.  The 
trailing  foot  is  quickly  re-planted  on  the  surface  and  the  control  loops  stabilize  as 
the  system  transitions  into  double  support  mode.  In  preparation  for  resuming  the 
motion,  the  switching  algorithm  is  invoked  to  define  the  forward  leg  as  the 
support  leg.  Finally,  the  gait  parameter  selection  algorithm  chooses  a reduced 
progression  velocity  to  compensate  for  the  slippery  surface  and  progression  is 
resumed.  The  magnitude  of  the  joint  torques  that  are  applied  during  the  recovery 
are  not  significantly  larger  than  those  required  to  maintain  progression  prior  to 
slipping. 

Figure  6.5  shows  the  biped  walking  on  a level  grade  surface  with  a 
progression  velocity  of  0.8  m/sec.  The  gait  parameters  are  identical  to  those  in 
Figure  5.12.  The  output  shows  several  successful  steps  before  encountering  the 
region  with  reduced  coefficient  of  friction  (0.37).  When  the  leading  foot  makes 
contact  with  the  slippery  surface  it  immediately  slips.  The  slip  recovery  proceeds 
in  a manner  virtually  identical  to  the  previous  case.  The  slip-reflex  logic  is 
activated,  the  trailing  foot  is  quickly  re-planted,  control  loops  stabilize  as  the 
system  transitions  into  double  support  mode,  and  progression  is  resumed  at  a 
reduced  velocity. 
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Figure  6.4  - Progression  and  slip  recovery,  0.2  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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Figure  6.5  - Progression  and  slip  recovery,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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6.1.4  Phase  Plane  Portraits 

Figure  6.6  contains  the  five  phase  plane  portraits  for  the  progression  and 
slip  recovery  depicted  in  Figure  6.5.  For  comparison,  each  portrait  also  contains 
the  progression  and  slipping  without  reflexive  compensation  (dotted).  The 
locomotion  begins  from  a double  support  (standing)  mode  in  which  all  the  joint 
angular  velocities  are  zero  (point  ‘0’).  As  usual  a stable  limit  cycle  is  established 
between  points  ‘1’,  ‘2’,  and  ‘3’.  The  state  trajectories  deviate  from  this  limit  cycle 
after  first  contact  with  the  slippery  surface.  The  impulsive  forces  resulting  from 
the  slipping  impact  solution  result  in  slightly  different  joint  angular  velocities  that 
appear  amplified  after  switching  (point  ‘4’).  Shortly  after  this  point,  the  reflexes 
are  invoked  and  the  reflexive  trajectories  (solid)  diverge  from  the  non-reflexive 
(dotted).  The  large  phase  plane  oscillations  that  have  begun  in  the  support  leg 
ankle  (63)  and  knee  joints  (0^)  are  contained  and  damped  by  the  reflexive 

control.  The  rear  foot  is  re-planted  and  makes  contact  at  point  ‘5’.  There  is  a very 
slight  discontinuity  in  angular  velocities  as  a result  of  this  impact  (point  ‘6’).  The 
switching  algorithm  then  causes  the  shift  to  point  7’.  Now  in  double  support 
mode,  the  joint  trajectories  are  quickly  brought  to  steady  state  (point  ‘8’).  For 
clarity,  the  subsequent  resumption  of  progression  at  a much  slower  progression 
velocity  is  not  shown  in  the  phase  plane  portraits. 

6.1.5  Slip  Recovery  Boundary 

We  have  shown  successful  slip  recovery  at  two  distinct  progression 
velocities  when  stepping  onto  surfaces  with  two  corresponding  friction 
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Figure  6.6  - Phase  Plane  Portrait,  Progression  and  Slip  Recovery,  0.8  m/sec 
a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 


coefficients.  At  any  given  progression  velocity  there  exists  a surface  friction 
coefficient  below  which  even  the  reflexive  control  responses  will  be  defeated. 
The  slip  recovery  boundary  is  defined  as  the  minimum  coefficient  of  friction  from 
which  a slip  is  recoverable.  The  biped  robot  has  been  exercised  over  a wide 
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range  of  progression  velocities,  stepping  onto  a range  of  surface  friction 
coefficients.  At  each  velocity  the  friction  coefficient,  starting  from  the  slip 
boundary,  was  reduced  in  increments  of  0.005.  The  lowest  friction  coefficient 
upon  which  the  robot  slipped  and  recovered  determined  the  slip  recovery 
boundary  at  that  velocity.  Figure  6.7  shows  the  slip  boundary  and  the  slip 
recovery  boundary  plotted  versus  progression  velocity.  The  benefit  of  the 
reflexive  slip  recovery  algorithm  is  clearly  visible  as  the  area  between  the  two 
boundaries.  At  low  progression  velocities  the  robot  is  able  to  recover  after 
encountering  extremely  low  surface  friction  coefficients  (less  than  0.005). 


Figure  6.7  - Slip  and  Slip  Recovery  Boundaries 
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The  benefit  diminishes  slightly  at  higher  progression  velocities.  Higher 
progression  velocities  correspond  to  higher  system  velocities.  The  slip  detection 
algorithm  requires  a minimum  of  20  milliseconds  of  slipping  before  slip  reflexes 
are  activated.  20  milliseconds  of  unimpeded  slipping  translates  into  significantly 
larger  trajectory  excursions  at  these  high  system  velocities  than  at  the  lower 
velocities. 

During  the  slipping  event  the  support  foot  may  slip  either  forward  or 
backward  along  the  surface.  In  fact  the  direction  of  the  motion  may  reverse  any 
number  of  times  as  time  progresses.  The  slip  direction  will  depend  on  the  friction 
coefficient,  the  mass  and  inertia  of  the  links,  the  system  velocities,  and  the 
applied  torques.  The  translation  of  the  support  foot  is  therefore  extremely  non- 
linear and  complicated.  Due  to  the  unpredictable  translation  of  the  support  foot 
during  slipping  and,  to  a lesser  degree,  joint  trajectory  tracking  errors,  it  is 
impossible  to  accurately  predict  the  ultimate  location  of  the  rear  foot  touchdown. 
Figure  6.8  shows  several  possible  swing  leg  tip  trajectories  that  may  occur  during 
slipping.  The  friction  discontinuity  is  shown  and  the  prior  step  setback  is  defined 


Figure  6.8  - Prior  Step  Setback  Definition 
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as  the  separation  between  the  discontinuity  and  the  prior  step  foothold.  The 
figure  illustrates  the  unpredictable  nature  of  the  rear  foot  touchdown  location. 

The  horizontal  location  of  the  rear  foot  re-plant  is  important  since  it  is  possible  for 
the  swing  foot  to  encounter  the  same  surface  conditions  which  caused  the 
support  foot  to  slip  after  the  previous  step.  During  this  research  we  have  selected 
the  location  of  the  friction  discontinuity  to  ensure  the  rear  foot  would  avoid  the 
slippery  surface  upon  touchdown.  This  required  the  previous  step’s  foothold 
meet  a minimum  horizontal  setback  from  the  friction  discontinuity.  The  required 
prior  step  setback  has  been  quantified  in  a fashion  similar  to  the  slip  recovery 
boundary.  The  biped  robot  was  exercised  over  a range  of  progression  velocities 


Figure  6.9  - Prior  Step  Setback  Required  for  Recovery 
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stepping  onto  a range  of  surface  friction  coefficients.  After  each  successful 
recovery,  the  horizontal  translation  of  the  rear  foot  during  recovery  was 
calculated  and  stored.  The  prior  step  setback  boundary  was  determined  as  the 
largest  measured  horizontal  translation  at  each  progression  velocity.  The  prior 
step  setback  boundary,  along  with  the  commanded  step  length,  is  shown  versus 
progression  velocity  in  Figure  6.9.  For  most  progression  velocities,  the  required 
setback  is  much  less  than  half  the  commanded  step  length.  Recovery  is  more 
likely  at  these  velocities  since  the  chances  of  setback  violation  are  small.  At  the 
very  high  velocities,  the  likelihood  of  setback  violation  increases  thereby 
decreasing  the  chances  of  slip  recovery.  At  the  very  low  progression  velocities, 
the  required  setback  is  greater  than  the  commanded  step  length.  This  does  not 
mean  that  slip  recovery  is  impossible  at  these  speeds.  This  indicates  only  that  at 
least  one  of  the  friction  coefficients  tested  resulted  in  a positive  rear  foot 
translation  beyond  the  commanded  step  length.  Most  of  the  cases  tested 
exhibited  negative  translation  or  positive  translation  less  than  the  commanded 
step  length. 

6.2  Reflexive  Tripping  Control 

In  Chapter  5 we  demonstrated  the  susceptibility  of  the  bipedal  robot  to 
tripping.  In  this  section  we  develop  reflexive  response  to  prevent  loss  of  stability 
due  to  tripping.  Reflexive  trip  recovery  strategies  are  proposed  for  each  of  the 
three  possible  trip  regions.  These  reflexes  are  smoothly  integrated  into  the 
existing  control  structure  and  their  effectiveness  is  demonstrated. 
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6.2.1  Trip  Detection  / Reflex  Activation 

Trip  detection  may  be  easily  performed  via  foot  mounted  contact  sensors 
which  are  readily  available.  The  contact  sensors  must  be  incorporated  into  the 
foot  design  so  that  tangential  (tripping)  contact  may  be  distinguished  from  the 
normally  expected  vertical  contact.  False  detection  is  far  less  likely  with  this  type 
of  sensor  and  therefore  no  special  accommodation  logic  is  required.  Reflex 
activation  will  occur  as  soon  as  the  tangential  contact  sensor  signal  is  received. 

As  with  the  reflexive  slipping  control,  both  the  phase  selector  and  the  gait 
parameter  selector  algorithms  will  require  modification  to  implement  the  tripping 
reflexes  (see  Figure  6.2).  The  phase  selector  algorithm  is  modified  to  create  a 
new  locomotion  phase  called  the  ‘trip  reflex’.  Figure  6.10  depicts  the  new  state 
diagram.  The  trip  reflex  phase  is  initiated  by  the  contact  sensor  signal.  Initiation 
of  this  new  locomotion  phase  represents  the  primary  high-level  trip  reflex. 


Figure  6.10  - Phase  Selector  State  Diagram  (Reflexive) 

6.2.2  Trip  Recovery  Strategies 

In  section  5.3  we  showed  that  tripping  can  occur  in  any  of  three  distinct 
regions  of  the  gait  cycle.  We  evaluated  the  performance  of  the  nominal  control 
system  when  encountering  obstacles  in  each  of  these  three  regions.  We  now 
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use  this  evaluation  information  to  develop  our  trip  recovery  strategies.  In  the  two- 
dimensional  model,  accommodation  of  the  initial  tripping  event  may  be  handled 
in  one  of  two  fundamental  ways:  step  over  the  obstacle  or  step  short  of  it.  Once 
this  decision  is  made  and  successfully  executed,  the  task  of  trip  recovery 
becomes  largely  a task  of  subsequent  cycle  trip  avoidance.  The  approximate 
location  and  the  minimum  possible  height  of  the  obstacle  can  be  deduced  after 
the  initial  contact.  The  decision  to  step  over  the  obstacle  or  short  of  the  obstacle 
and  the  extent  of  the  subsequent  trip  avoidance  task  depends  on  which  region  of 
the  gait  cycle  the  unplanned  ground  contact  first  occurs. 

We  saw  in  section  5.3  that  region  ‘111’  contact  produced  moderate 
disruption  of  the  planned  trajectories,  but  that  the  nominal  control  system  was 
able  to  quickly  resume  normal  progression.  Attempting  to  step  over  the  obstacle 
is  obviously  the  right  choice  in  this  region  since  stepping  short  of  the  obstacle  will 
serve  no  purpose.  The  height  of  the  object  is  limited  in  size  by  the  previous 
step’s  tip  trajectory.  Contact  in  this  region  occurs  relatively  early  in  the  gait  cycle 
allowing  ample  time  to  re-capture  the  target  trajectories.  Since  contact  in  this 
region  can  involve  only  the  rear  foot,  no  subsequent  trip  avoidance  measures  are 
required.  We  saw  that  region  ‘IT  contact  also  produced  a moderate  disruption  of 
the  planned  trajectories  but  that,  once  clear  of  the  object,  the  target  foothold  was 
eventually  achieved.  In  region  ‘n’  the  robot  is  capable  of  stepping  over  the 
obstacle,  since  contact  occurs  early  enough  in  the  gait  cycle  to  allow  re-capture 
of  the  target  trajectories.  The  configuration  is  not  significantly  extended  and  the 
center  of  gravity  is  still  close  to  the  point  of  support.  After  the  region  ‘IT  contact 
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we  saw  the  rear  foot  make  contact  with  the  same  obstacle  unnecessarily. 
Subsequent  trip  avoidance  measures  are  required  for  the  gait  cycle  immediately 
following  a region  ‘If  contact.  We  saw  in  section  5.3  that  region  ‘I’  contact 
represented  a significant  disruption  of  the  planned  trajectories  that  ultimately 
resulted  in  loss  of  stability.  The  contact  occurs  near  the  end  of  the  gait  cycle 
where  the  biped  is  reasonably  extended.  The  extension  makes  stepping  over  the 
obstacle  more  costly  in  terms  of  control  power  requirements.  The  application  of 
large  joint  torques  in  this  position  is  more  likely  to  cause  the  support  foot  to  slip. 
Stepping  short  of  the  obstacle  is  the  better  alternative  in  this  region.  After 
stepping  short  of  an  obstacle,  trip  avoidance  measures  must  be  taken  for  the  two 
subsequent  steps  since  neither  foot  has  cleared  the  object. 

Stepping  over  the  obstacles  after  they  are  encountered  is  accomplished 
by  adjusting  the  target  step  height  and  the  initial  step  length.  Although  the 
nominal  control  was  able  to  clear  the  objects  without  these  adjustments,  they  will 
allow  the  foot  to  clear  the  object  more  consistently  and  with  less  control  effort. 
The  initial  step  height  is  selected  such  that  the  peak  of  the  swing  leg  tip  trajectory 
will  occur  directly  above  the  face  of  the  object.  This  is  referred  to  as  ‘step 
centering’.  Step  centering  limits  the  likelihood  of  obstacle  interference.  How  to 
adjust  the  step  height  remains  a question.  The  answer  is  obvious  if  the  obstacle 
height  is  exactly  known,  but  if  that  were  the  case  we  would  have  avoided  the 
obstacle  altogether.  We  do  know  that  the  obstacle  is  at  least  as  high  as  the  point 
of  contact.  We  also  know  that  the  ground  profile  sensor  failed  to  detect  the 
obstacle.  These  two  pieces  of  information  may  be  used  as  a guide  to  decide  the 
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step  height  adjustment.  For  the  purposes  of  our  study,  we  assume  all  obstacles 
larger  than  6.0  centimeters  in  height  will  be  identified  by  the  ground  profile 
sensor  and  therefore  avoided  a priori. 

Stepping  short  of  an  obstacle  is  easily  accomplished  through  the 
adjustment  of  the  target  final  step  length.  When  stepping  short  of  an 
encountered  obstacle  we  would  like  to  position  the  foot  as  far  from  the  known 
obstacle  position  as  possible.  This  desire  is  often  directly  contrary  to  the  biped 
velocities,  available  control  power,  and  the  time  available  before  impact. 
Adjusting  the  target  final  step  length  to  a value  well  short  of  the  obstacle  will 
ensure  the  most  advantageous  foot  placement  is  achieved. 

Trip  avoidance  requires  choosing  a target  swing  leg  tip  trajectory  that  will 
clear  the  obstacle  before  it.  The  position  of  the  obstacle  is  known,  and  the  height 
may  be  conservatively  assumed  to  be  the  largest  that  might  escape  the  ground 
profile  sensor  (6.0  centimeters).  Using  the  standard  quadratic  trajectory  built  into 
the  gait  synthesis  algorithm  and  applying  a small  margin  (0.5  cm)  for  tracking 
error,  we  may  calculate  the  required  step  height  to  clear  the  object.  The  required 
step  height  will  depend  on  the  desired  step  length  and  the  initial  distance  from 
the  object.  Figure  6.1 1 shows  the  required  step  height  plotted  versus  initial 
distance  from  the  obstacle  for  various  target  step  lengths.  We  conclude  from 
Figure  6.1 1 that  prohibitively  large  target  step  heights  are  required  to  clear 
objects  closer  than  a few  centimeters.  It  is  likely  after  a region  ‘I’  impact  that  the 
swing  leg  will  be  positioned  very  close  to  the  obstacle.  It  is  of  course  possible  for 
the  swing  leg  to  start  from  a position  immediately  adjacent  to  the  obstacle.  We 
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Figure  6.1 1 - Required  Step  Height  for  6cm  Obstacle  Avoidance 


need  a solution  that  will  avoid  the  obstacle  even  from  this  position.  This  will 
require  a swing  leg  tip  trajectory  that  travels  vertically  or  even  rearward  as  it 
initially  rises  from  the  ground. 

One  possible  solution  is  to  deviate  from  the  quadratic  trajectory 
assumption.  A cubic  trajectory  could  certainly  satisfy  the  obstacle  avoidance 
requirement.  A cubic  trajectory  would  require  additional  gait  parameters  to 
constrain  the  solution  to  be  above  the  walking  surface  from  toe-off  to  touchdown. 
The  use  of  a cubic  would  add  unnecessary  complexity  to  the  standard  gait  and 
would  require  gait  parameters  with  less  than  obvious  physical  interpretation.  The 
cubic  trajectory  alternative  was  abandoned  and  we  focused  on  finding  a way  to 
achieve  the  desired  trajectories  using  the  existing  quadratic  trajectory  and  gait 
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parameters.  A very  simple,  robust,  and  elegant  solution  was  invented  that 
requires  modification  of  just  three  of  the  existing  gait  parameters:  step  height, 
initial  step  length,  and  tip  phase  coefficient.  Adjusting  the  initial  step  length  and 
the  step  height  together  provides  a quadratic  target  trajectory  that  clears  the 
obstacle  without  requiring  excessively  high  step  heights.  This  alone  does  not 
achieve  the  desired  result.  Since  swing  leg  tip  horizontal  position  depends  on  the 
horizontal  position  of  the  hip,  the  target  position  at  the  time  of  toe-off  will  not 
create  the  rearward  motion  that  is  required.  Recall  from  Chapter  4 that  the  tip 
phase  coefficient  represents  the  dynamic  relationship  between  the  horizontal 
position  of  the  tip  of  the  swing  leg  and  that  of  the  hip.  The  tip  phase  coefficient  is 
the  key  to  the  desired  trajectory  when  used  in  conjunction  with  initial  step  length 
and  step  height. 

6.2.3  Effectiveness  of  Reflexive  Tripping  Control 

The  reflexive  tripping  control  has  been  extensively  evaluated  using 
randomly  positioned  obstacles  of  varying  heights  (up  to  6.0  cm)  over  a range  of 
progression  velocities.  In  all  cases  tested,  the  biped  overcame  the  obstacle  with 
minimal  disruption  to  the  progression.  The  effectiveness  of  the  reflexive  tripping 
control  is  now  demonstrated  in  Figures  6.12  through  6.14.  The  scenarios 
presented  are  identical  to  those  that  were  previously  used  to  evaluate  the 
nominal  control  algorithm  (Figures  5.17  through  5.19).  The  horizontal  and  vertical 
positions  of  the  swing  leg  tip  are  plotted  versus  time  at  the  top  of  each  figure. 
Also  displayed  are  the  five  joint  angles  and  applied  joint  torques.  The  bottom  of 
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each  figure  contains  the  swing  leg  tip  vertical  position  plotted  versus  the 
horizontal  position,  as  well  as  a gait  visualization  diagram. 

Figure  6.12  demonstrates  unexpected  tangential  ground  contact  in  region 
‘I’  of  the  gait  cycle.  The  swing  leg  tip  encounters  a 6 centimeter  square  object  at 
a point  approximately  2.7  meters  from  the  origin.  Impact  occurs  at  approximately 
85%  of  the  step  cycle.  Based  on  the  region  of  contact  the  reflexive  tripping 
control  algorithm  executes  the  ‘step  short’  strategy  while  simultaneously  reducing 
the  progression  velocity.  Once  stabilized  the  subsequent  step  trip  avoidance 
algorithm  is  invoked.  The  step  immediately  following  the  tripping  event  requires 
modification  of  only  the  step  height  and  initial  step  length.  This  is  based  on  the 
known  obstacle  position,  the  estimated  height  and  the  position  of  the  support 
foot.  This  step  easily  clears  the  obstacle.  The  second  step  following  the  tripping 
event  requires  modification  of  the  step  height,  initial  step  length,  and  the  tip 
phase  coefficient  in  order  to  avoid  the  obstacle  positioned  directly  in  front  of  it. 
The  resulting  tip  trajectories  are  shown  in  Figure  6.12m.  The  reflexive  tripping 
control  successfully  avoids  loss  of  stability  and  the  object  is  successfully  avoided 
during  subsequent  steps.  All  of  this  is  performed  with  minimal  affect  on  the 
forward  progression.  The  trip  recovery  algorithm  requires  somewhat  larger 
applied  joint  torques  in  the  support  leg.  The  relatively  large  torques  are  required 
to  slow  the  progression  after  the  ‘step  short’  maneuver  and  re-establish  the 
progression  shortly  thereafter. 
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Figure  6.12  - Progression  and  trip  recovery,  Region  T,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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Figure  6.13  demonstrates  unexpected  tangential  ground  contact  in  region 
‘ir  of  the  gait  cycle.  The  swing  leg  tip  encounters  a 6 centimeter  square  object  at 
a point  approximately  2.4  meters  from  the  origin.  Impact  occurs  at  approximately 
55%  of  the  step  cycle.  Based  on  the  region  of  contact  the  reflexive  tripping 
control  algorithm  executes  the  step  over  strategy.  The  step  height  is  adjusted 
and  once  clear  of  the  obstacle  the  target  trajectory  is  quickly  re-captured  and 
touch  down  is  made  at  the  targeted  position.  The  step  immediately  following  the 
tripping  event  requires  modification  of  the  step  height,  initial  step  length,  and  the 
tip  phase  coefficient  in  order  to  avoid  the  obstacle  whose  position  is  now  known. 
The  resulting  tip  trajectories  are  shown  in  Figure  6.13m.  The  reflexive  tripping 
control  maintains  stability  and  the  object  is  successfully  avoided  during  the 
subsequent  step. 

Figure  6.14  demonstrates  unexpected  tangential  ground  contact  in  region 
‘nr  of  the  gait  cycle.  The  swing  leg  tip  encounters  a 4.0  centimeter  square  object 
at  a point  approximately  2.5  meters  from  the  origin.  Impact  occurs  at 
approximately  1 5%  of  the  step  cycle.  The  left  foot  had  cleared  the  obstacle 
without  contact  on  the  previous  step.  Based  on  the  region  of  contact  the  reflexive 
tripping  control  algorithm  executes  the  step  over  strategy.  The  step  height  is 
adjusted  and  once  clear  of  the  obstacle  the  target  trajectory  is  quickly  re- 
captured and  touchdown  is  made  at  the  targeted  position.  For  contact  in  this 
region,  the  only  improvement  over  the  nominal  control  is  that  the  reflexive  control 
is  able  to  track  a more  reserved  tip  trajectory  requiring  less  control  energy.  No 
subsequent  trip  avoidance  measures  are  required. 
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Figure  6.13  - Progression  and  trip  recovery,  Region  ‘n’,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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Figure  6.14  - Progression  and  trip  recovery,  Region  ‘HI’,  0.8  m/sec 
a)  Swing  leg  tip  horizontal  position;  b)  Swing  leg  tip  vertical  position;  c)  Support 
ankle  angle;  d)  Support  ankle  torque;  e)  Support  knee  angle;  f)  Support  knee 
torque;  g)  Support  hip  angle;  h)  Support  hip  torque;  i)  Swing  hip  angle;  j)  Swing 
hip  torque;  k)  Swing  knee  angle;  I)  Swing  knee  torque;  m)  Swing  leg  tip  vertical 
position  versus  horizontal  position;  n)  Gait  diagram 
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6.2.3  Phase  Plane  Portraits 

Figure  6.15  contains  the  five  phase  plane  portraits  for  the  progression  and 
region  T trip  recovery  depicted  in  Figure  6.12.  For  clarity  we  will  focus  on  the 


Theta(7)  [rad] 


Figure  6.15  - Phase  Plane  Portraits,  Progression  and  trip  recovery, 

Region  T,  0.8  m/sec 

a)  Support  ankle;  b)  Support  knee;  c)  Support  hip;  d)  Swing  hip;  e)  Swing  knee 


118 


Theta(5)  [rad] 


Figure  6.16  - Swing  Knee  Phase  Plane  Portrait,  Progression  and  trip  recovery, 

Region  T,  0.8  m/sec 


swing-knee  phase  plane  portrait  which  has  been  reproduced  with  further 
annotation  in  Figure  6.16.  Referring  to  Figure  6.16  then,  the  locomotion  begins 
from  a double  support  (standing)  mode  in  which  all  the  joint  angular  velocities 
are  zero  (point  ‘0’).  Once  again,  a stable  limit  cycle  is  quickly  established 
between  points  T,  ‘2’,  and  ‘3’.  The  state  trajectories  deviate  from  this  limit  cycle 
after  first  contact  with  the  obstacle  (point  ‘4’).  The  ‘step  short’  reflex  is  invoked 
resulting  in  surface  contact  at  point  ‘5’.  There  is  a very  slight  discontinuity  in 
angular  velocities  as  a result  of  impact  (point  ‘6’).  The  switching  algorithm  then 
causes  the  shift  to  point  ‘7’.  The  state  trajectory  between  points  ‘7’  and  ‘8’ 
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represents  the  motion  of  the  rear  foot  as  it  steps  over  the  previously  encountered 
object.  Points  ‘8’,  ‘9’,  and  ‘10’  represent  the  contact,  impact  and  switching  that 
occur  while  the  biped  straddles  the  obstacle.  The  state  trajectory  between  points 
‘10’  and  ‘11’  represents  the  motion  of  the  original  foot  as  it  too  avoids  the 
obstacle.  Points  ‘11’,  ‘12’,  and  ‘13’  represent  the  contact,  impact  and  switching 
that  occur  when  the  biped  is  completely  clear  of  the  obstacle.  The  state  trajectory 
then  quickly  re-captures  the  stable  limit  cycle  between  points  ‘1’,  ‘2’,  and  ‘3’. 

6.2.4  Larger  Obstacle  Trip  Recovery 

We  have  thus  far  assumed  that  the  biped  is  equipped  with  a ground 
profile  sensor  that  is  capable  of  some  known  resolution.  This  resolution  is  used 
to  set  the  target  step  height  during  the  step-over  and  trip  avoidance  maneuvers. 

It  would  be  desirable  to  retain  the  trip  recovery  capability  in  the  event  the  ground 
profile  sensor  is  absent  or  malfunctioning.  The  trip  recovery  algorithm  is  easily 
modified  to  successively  increase  the  target  step  height,  during  the  step-over 
and  trip  avoidance  maneuvers,  until  the  object  is  cleared.  This  minor  adjustment 
to  the  algorithm  removes  the  dependency  on  the  ground  profile  sensor  and 
allows  the  biped  to  overcome  larger  obstacles.  There  is  a drawback  to 
completely  eliminating  the  ground  profile  sensor.  Without  a sensor  the  biped  is 
likely  to  trip  over  any  obstacle  large  or  small  and  subsequent  step  obstacle 
avoidance  is  not  guaranteed.  To  illustrate  the  successive  step  height  adjustment 
we  will  focus  on  the  region  ‘I’  contact.  Figure  6.17  demonstrates  unexpected 
region  T contact  with  an  obstacle  twice  the  size  of  the  expected  sensor 
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Figure  6.17  - Progression  and  large  obstacle  trip  recovery,  Region  T,  0.8  m/sec 

resolution.  The  step-short  strategy  is  executed  in  the  same  manner  regardless  of 
the  obstacle  size.  Once  stabilized  the  subsequent  step  trip  avoidance  algorithm 
is  invoked,  and  the  desired  step  height  is  adjusted  to  easily  clear  an  obstacle  as 
high  as  the  expected  sensor  resolution  of  6 centimeters.  Since  this  obstacle  is 
twice  this  size,  the  step  fails  to  clear  the  obstacle.  When  tangential  contact  with 
the  obstacle  is  again  made,  the  step  height  is  increased  further.  Upon  each 
successive  encounter,  the  target  step  height  is  increased  by  the  expected 
ground  profile  sensor  resolution.  Eventually,  the  swing  leg  clears  the  obstacle 
and  the  height  of  the  obstacle  is  now  more  accurately  known.  The  second  step 
following  the  tripping  event  requires  modification  of  the  step  height,  initial  step 
length,  and  the  tip  phase  coefficient  in  order  to  avoid  the  obstacle  positioned 
directly  in  front  of  it.  Availed  of  the  more  accurate  obstacle  height  estimate,  the 
second  step  easily  clears  the  obstacle. 

There  is  obviously  a practical  limit  on  the  size  of  obstacles  that  may  be 
overcome.  The  maximum  obstacle  size  will  be  limited  only  by  the  practical  limit 
on  step  height.  This  is  a direct  result  of  the  step  centering  aspect  of  the  tripping 
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algorithm.  Step  heights  are  limited  by  the  biped  kinematics.  Step  heights  larger 
than  the  biped’s  hip  height  are  obviously  impractical  since  they  would  require  the 
swing  leg  knee  to  violate  it’s  singularity  at  180  degrees.  It  is  not  unreasonable  to 
allow  step  heights  as  high  or  slightly  higher  than  the  support  leg  knee  however. 

In  the  absence  of  any  other  kinematics  constraints  the  practical  limit  on  step 
height  is  near  the  biped’s  mid-thigh. 

6.2.5  Trip  Recovery  Discussion 

We  have  chosen  to  ignore  the  issue  of  lower  leg  penetration  of  the 
obstacle.  The  constraint  equations  utilized  ensure  the  swing  leg  tip  will  not 
penetrate  the  obstacle.  No  such  constraint  has  been  applied  to  the  leg  member. 
This  is  a reasonable  assumption  since  an  actual  practical  robot  will  require  feet. 
Figure  6.18  illustrates  that  the  existence  of  feet  will  increase  the  separation 
between  the  lower  leg  and  the  obstacle.  As  long  as  the  undetected  obstacles  are 
small  relative  to  the  length  of  the  lower  leg,  penetration  will  likely  be  avoided. 


(a)  (b) 


Figure  6.18  - Lower  leg  obstacle  penetration 
a)  Penetration  without  feet;  b)  No  penetration  with  feet 


CHAPTER  7 
CONCLUSION 


7.1  Summary 

This  research  has  investigated  the  effects  of  large  magnitude 
disturbances  due  to  slipping  and  tripping  on  the  stability  of  an  anthropomorphic 
bipedal  locomotion  system.  We  have  demonstrated  the  system’s  susceptibility  to 
loss  of  stability  in  the  wake  of  these  large  disturbances.  We  have  identified 
unique  reflexive  control  mechanisms  and  a unique  control  system  architecture 
that  significantly  improve  the  robustness  of  the  system  to  ground  contact  errors. 

This  study  has  been  performed  via  mathematical  simulation  of  a planar 
five-link  biped  model  and  closed-loop  control  system.  The  equations  of  motion 
are  derived  using  the  Euler-Lagrange  differential  equation  and  the  Denavit- 
Hartenberg  coordinate  frame  representation.  The  equations  of  impact  are 
derived  using  the  principles  of  linear  and  angular  impulse  and  momentum.  The 
equations  are  formulated  and  simulated  to  correctly  model  surface  friction  effects 
and  slipping. 

A unique  control  system  architecture  was  formulated  to  accommodate  all 
phases  of  locomotion  including  standing,  starting,  progression  and  stopping.  The 
control  system  is  goal  directed  and  capable  of  varying  step  length  and  step 
height  independently.  The  controlled  biped  is  capable  of  sustained  locomotion 
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with  varying  progression  velocity  over  various  surface  grades.  The  unique  on-line 
gait  synthesis  algorithm  is  cast  in  high-level  physically  meaningful  parameters 
that  facilitate  integration  with  the  higher  level  path  planning  function.  The 
formulation  of  the  gait  synthesis  algorithm  also  elegantly  accommodates  gait 
optimization  and  greatly  simplifies  the  incorporation  of  reflexive  responses.  Joint 
trajectory  tracking  was  performed  using  the  robust  feedback  linearization 
technique  known  as  sliding  mode  control. 

Sub-optimal  gait  synthesis  parameters  have  been  determined  via  off-line 
optimization  of  average  control  power.  These  gait  parameters  are  selected  as  a 
function  of  the  desired  progression  velocity  and  define  the  subspace  about  which 
the  biped  performance  has  been  evaluated.  These  Sub-optimal  gait  parameters 
are  proposed  as  the  basis  of  any  on-line  gait  optimization  algorithm. 

The  basic  capabilities  of  the  nominally  controlled  bipedal  locomotion 
system  have  been  demonstrated  via  simulation  results.  The  capability  to 
negotiate  various  known  surface  grades  at  various  velocities  has  been 
demonstrated  as  well  as  starting,  stopping,  and  control  in  double  support  mode. 
The  nominal  control  system  was  also  shown  to  have  the  ability  to  negotiate 
varying  (rough)  terrain  of  unknown  profile. 

We  have  demonstrated  the  system’s  susceptibility  to  loss  of  stability  after 
undergoing  ground  contact  errors  of  slipping  and  tripping  during  level  grade 
progression.  The  effects  of  slipping  have  been  evaluated  by  progression  over  an 
abrupt  change  in  surface  friction  coefficient  at  a location  that  was  unknown  to  the 
robot  control  system.  Slipping  has  been  shown  to  result  in  extremely  rapid  and 
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complete  loss  of  control  at  all  conditions.  The  model  based  tracking  control  was 
shown  to  be  a contributing  factor  to  the  speed  with  which  system  stability  is  lost. 
The  effects  of  tripping  have  been  evaluated  by  progression  over  an  obstacle  of 
unknown  size  at  a location  that  was  unknown  to  the  robot  control  system.  The 
susceptibility  to  loss  of  control  due  to  tripping  was  shown  to  be  dependent  on  the 
region  of  the  gait  cycle  in  which  contact  was  made.  Region  ‘I’  contact  was  shown 
to  result  in  complete  loss  of  control  at  most  conditions.  Contact  in  regions  ‘IT  and 
‘in’  were  shown  to  cause  significant  and  sometimes  repeated  disruptions  to  the 
gait  cycle,  but  stability  was  maintained  in  these  regions. 

Reflexive  slipping  and  tripping  control  strategies  have  been  identified  and 
investigated.  A reflexive  slipping  and  tripping  control  algorithm  has  been 
developed  and  smoothly  integrated  into  the  nominal  control  structure.  The 
reflexive  control  algorithm  has  been  shown  to  successfully  reject  the  large 
magnitude  disturbances  due  to  slipping  and  tripping  over  a wide  range  of 
conditions.  The  improvements  in  robustness  of  the  reflexively  controlled 
locomotion  system  have  been  quantified. 

7.2  Future  Research 

Although  we  have  demonstrated  significant  robustness  improvements  with 
respect  to  slipping  and  tripping,  there  remains  a great  deal  of  work  to  be  done 
toward  the  goal  of  a truly  robust  autonomous  biped. 

The  most  pressing  task  for  future  research  will  be  the  extension  of  the 
proposed  methodology  into  three  dimensions.  A truly  realizable  algorithm  will 
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necessarily  be  three-dimensional.  This  will  require  developing  a three 
dimensional  bipedal  locomotion  system  model  which  correctly  handles  slipping 
along  the  surface.  The  third  dimension  introduces  complexity  into  the  slipping 
solution.  Extension  of  the  gait  synthesis  algorithm  and  tracking  control  is  also 
required  but  should  be  relatively  straightforward.  The  complexity  of  the  slip-reflex 
algorithm  will  likely  increase  since  the  location  of  the  rear  foot  re-plant  will  be 
more  critical  in  maintaining  system  stability.  The  trip-reflex  algorithm  will  need  to 
be  modified  to  accommodate  an  additional  trip  region  as  highlighted  in  section 
5.3. 

The  reflexive  slipping  and  tripping  control  algorithms  have  been  developed 
and  tested  on  level  grade  surfaces.  Extension  of  the  algorithm  to  accommodate 
graded  surfaces  is  necessary.  Since  the  reflexive  algorithms  make  use  of  mostly 
high  level  reflexes,  the  extension  to  non-level  grade  surfaces  is  likely  to  be 
straightforward. 

The  reflexive  tripping  control  algorithm  was  developed  assuming  a single 
obstacle.  A logical  extension  of  the  trip  recovery  algorithm  is  the  ability  to  handle 
multiple  obstacles  in  succession.  This  extension  will  likely  not  require  any  new 
reflexes,  just  recursive  execution  of  the  existing  modes. 


APPENDIX  A 

LAGRANGIAN  FORMULATION  OF  EQUATIONS  OF  MOTION  USING 
DENAVIT-HARTENBERG  COORDINATE  FRAME  REPRESENTATION 

Let  q.  = q, ,q2,--.,qn  be  the  generalized  coordinates  that  completely 
characterize  the  system.  Let  K be  the  total  kinetic  energy  of  the  system  and  V 
the  total  potential  energy  of  the  system.  The  function  L , called  the  ‘Lagrangian’, 
is  defined  as  follows: 


L = K-V.  (A.1) 

The  system  equations  of  motion  are  obtained  by  applying  the  differential 
equation  of  Euler-Lagrange  to  the  Lagrangian 


dt 


3L 

dq, 


= Qi,i  = l,...,n, 


(A.2) 


where  is  the  generalized  force  corresponding  to  the  generalized  coordinate 


qj . Considering  the  virtual  work  done  by  non-conservative  forces  acting  on  the 
system  identifies  the  generalized  force.  The  total  kinetic  energy  of  a system  with 
n members  is 


K=lK|. 

1=1 


(A.3) 


where  Kj  is  the  kinetic  energy  of  the  i'^  member  which  is  the  integral  over  the 


volume  of  the  kinetic  energy  due  to  each  point  mass  diHj  given  by 
K.  = jdK,  = jivjvpidmi  = jjdm.Tr(VpiVj). 


(A.4) 
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Here  \^^  is  the  absolute  velocity  of  point  mass  dm. , and  Tr{ } is  defined  to  be  the 

trace  of  the  matrix  { }.  The  position  of  a point  on  link  i with  mass  dm;  is  depicted 
in  Figure  A.1 . 


The  absolute  position  of  dm;  (“ropj)  can  be  defined  in  terms  of  it’s  location 
relative  to  the  link  i coordinate  system  (‘fj  pj ) and  the  homogeneous 
transformation  matrix  (°T)  as 


0 


^O.pi 


=°T[‘r,pJ, 


(A.5) 


The  homogeneous  transformation  matrix  is  defined  in  terms  of  the  Denavit- 
Hartenberg  parameters  (aij,ay,dj,0j)  as  follows: 
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where  =Cos(0j),Sj  =Sin(0j),Cij  =Cos(ay),Sij  =Sin(ay). 
The  absolute  velocity  of  dm;  is  then 


(A.7) 


and  — ['fj  J = 0 since  the  member  is  assumed  rigid,  and  — 

dt  dt 


Therefore 
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for  revolute  joints  Qj  = Oj  , 


(A.9a) 


0 0 0 
0 0 0 0 


Co 


for  prismatic  joints  Qj  = d^ , 


(A.9b) 


This  can  be  written  as 


aKxJ  . 

-^=)TD., 

aqj 


(A.  10) 


where 
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for  revolute  joints  Qj  — Qj  , 
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for  prismatic  joints  Qj  = dj 


Therefore 
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(A.  11  a) 


(A.  11b) 


(A.  12) 


''pi  = 


j=l 


^i.pi 


(A.  13) 


Substituting  back  into  our  expression  for  kinetic  energy  and  utilizing  dummy 
indices  r and  s: 


j 
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jydnijTr- 

y D q ‘r  . 

irHr  i.pi 

Yd  q ‘r 

isHs  l,pi 

> 

_ s=l 

(A.  14) 


Noting  that  diHi,q^,q^  are  scalar  quantities  and  moving  the  integral  inside  yields 

(A.  15) 


_ r=l  S=1 


In  this  equation  are  constant  for  all  points  on  link  i and  are  independent 

of  the  mass  distribution.  Denote 

I.  = f‘r.  .‘r.^dm.  . (A-16) 

I J l.pi  l.pi  I 


The  matrix  I.  is  dependent  upon  the  mass  distribution  and  not  its  position  or  rate 
of  motion.  Letting  ‘rj  pj  = [r^pTypr^j,!]^  and  expanding 
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the  total  kinetic  energy  of  the  n member  system  is 


i=l 


. r=l  s=l 


(A.  17) 


(A.  18) 


The  potential  energy  of  a system  with  n members  is 


i=I 


(A.  19) 


where  V;  is  the  potential  energy  of  the  i'*^  member. 

Assuming  that  gravity  is  the  only  force  acting  on  the  system  that  is 
derivable  from  a potential  function,  and  that  the  origin  of  the  {0}  reference  frame 
is  the  zero  potential  reference, 


TO 


0,ci 


1=1 


1=1 


(A.20) 


where  g = and 


is  the  position  of  the  center  of  mass  of  link  i in 


the  link  i coordinate  system.  Therefore  the  Lagrangian  becomes 

L = K-V  = lXTr|ttD„(I,)D;q,q.}  + 

i=l  lr=l  s=l  J 

Evaluating  the  terms  necessary  for  the  Euler-Lagrange  equation: 
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d 


dh 


j 


+ 


0L 

dq, 


n k k 


k=i  j=l  m=i 


n k k 


+ 


TSiiT'-^).,(i»)DL}liq. 


k=i  j=l  m=l 


k=i 


where 


"jTD,[;T))J;T]j<m<k 

:TDj",Tt,[iT]m<j<k 

0,(j  > k)or(m  > k) 


Substituting  into  the  Euler-Lagrange  equation  yields 


n k 


n k k 


X I TrK,  ( Ik  )D:  })i  + £ £ X Tf  K»  (1 }iiq 


k=i  j=l 


k=i  j=l  m=I 


k=i 


(A.22a) 


(A.22b) 


(A.23) 


(A.24) 


More  compactly 
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k k 


XHuqj+XShijn,qjqm+Gi  =Qpi  = l,...,n  , 

j=l  j=l  m=l 


where 


(A.25) 


Hi,=  iTrKiCijD;:;} 

k=max(i.j) 


(A.26a) 


hijn,=  XTr|),.„(I,)D;[J 

k=max(i,j.m) 


(A.26b) 


k=i 


(A.26C) 


Alternately 


M(q)q  + H(q,q)  + G(q)  = T . 


(A.27) 


APPENDIX  B 

GROUND  REACTION  FORCES:  SUPPORT 
Calculation  of  the  ground  reaction  forces  in  the  support  phases  of  locomotion  is 
required  to  insure  the  biped  does  not  violate  the  ground  surface  constraint.  The 
support  force  vector  will  be  determined  by  solving  the  equations  of  motion 
subject  to  surface  constraints.  The  surface  constraints  depend  on  locomotion 
phase  and  on  the  surface  coefficient  of  friction.  Ground  reaction  force  vector 
solutions  are  derived  for  both  single  and  double  support  phases,  assuming  both 
slip  and  no-slip  conditions. 

Repeating  the  planar  five-link  biped  equations  of  motion 

Mq  + H + G = C,F,  + C2X  + jjFf +J^\  , (B.1) 

where 


c,  = 

^2x2 

and  C,  = 

Psx2  . 

z 

.^ix5  _ 

Rearranging  yields: 

q = M-'  [C,F,  -f-  C^x  + J JF,  + j/x,  - H - G] . (B-3) 

Equation  (B.3)  represents  the  generalized  acceleration  vector. 
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B.1  Single  Support 

In  single  support  mode  the  support  (base)  leg  is  in  contact  with  the  ground 
while  the  swing  (free)  leg  is  not.  Therefore  the  free  end  force  and  moment 
vectors  are  zero 

F,  =0,Xf=0.  (B.4) 

Since  the  support  leg  tip  position  is  included  in  the  equations  of  motion  as 
generalized  coordinates  it  can  be  extracted  as  follows: 

P.^c/q.  (B.5) 

Differentiating  (B.5)  twice  and  substituting  equation  (B.3)  and  (B.4)  yields  the 

acceleration  of  the  support  leg  tip 

p,  =C/M-'[C,Fb  + C2X-H-G].  (B.6) 

Since  our  surface  constraints  are  naturally  derived  in  surface  coordinates 
(normal  & tangential),  a general  solution  requires  a transformation  between 
reference  coordinates  (z,x)  and  surface  coordinates  (n,t)  as  follows: 

(B.7) 


where 


Cos(4>J  Sin(4)J 

-Sin(4»J  Cos(4)b) 


(B.8) 


and  (j)^  represents  the  surface  slope  at  the  point  of  support  leg  contact. 
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B.1.1  Single  Support : No  Slip 

Assuming  sufficient  friction  a no-slip  solution  may  be  obtained  by  setting 
the  support  leg  tip  acceleration  to  zero 


B.1.2  Single  Support : Slip 

When  the  tangential  force  exceeds  the  friction  force  a slipping  solution  is 
required.  Acceleration  of  the  support  leg  tip  normal  to  the  surface  will  remain 
zero,  but  acceleration  along  the  surface  is  unknown.  The  tangential  force  will  be 
related  to  the  normal  force  by  the  coefficient  of  friction  and  the  sign  of  the  leg  tip 
velocity  along  the  surface 


P^=0  = C/M^'[C,F,  + C2X-H-G]  . 


(B.9) 


Solving  for  the  support  leg  ground  reaction  force  yields 


Fb  = [C,^M“'C,  ]"'  C/M  ' [H  + G - C^x]  . 


(B.10) 


(B.11) 


Pb„  ~ Pb  > 


(B.12) 


(B.13) 


Substituting  and  setting  the  normal  acceleration  to  zero  we  obtain  the 


acceleration  of  the  support  leg  tip 


(B.14) 


Solving  for  the  support  leg  ground  reaction  force  yields 

F,  =R,C3jC,R,-'c/M-'C,R,C3j-'C,R,-'c/M-'[H-rG-C2X].  (B-15) 
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B.2  Double  Support 

In  double  support  mode  both  legs  are  in  contact  with  the  ground. 


Therefore  the  free  end  force  and  moment  vectors  are  non-zero 

FfvtO,Xf;iO.  (B.16) 

Combining  equations  (B.3)  and  (B.5)  we  obtain 

Pb  - [C,F,  + C^T  + J jFf  + J/Xf  - H - G] . (B- 1 7) 

Jl  is  the  Jacobian  matrix  which  relates  free  end  linear  velocities  to  joint 
velocities  as  shown 

Pf=JLq-  (B-18) 

Differentiating  yields 

Pf=JLq  + JLq-  (B-19) 

Substitution  yields  the  acceleration  of  the  swing  leg  tip 

p,=J,{M-'[C.F,+C,x  + jjF,+j/x,-H-G]}  + J,q  . (B-20) 


As  before,  a general  solution  requires  a transformation  between  reference 
coordinates  (z,x)  and  surface  coordinates  (n,t)  as  follows: 


"b 

- 

o 

o 

tb 

Rh 

Xb 

. R = 

b 

0 0 

z. 

0 0 

Ilf 

Rf 

- _ 

0 0 

where 


Rb  = 

Cos(<t)J 

Sin(0j' 

. Rf  = 

CosCpf ) 

Sin(<l)f)' 

_-Sin((t)b) 

Cos((l)J_ 

_-Sin(4f) 

Cos((t)f ) 

(B.22) 
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and  (])f  represent  the  surface  slopes  at  the  points  of  support  and  swing  leg 
contact  respectively. 

B.2.1  Double  Support : No  Slip 

Assuming  sufficient  friction,  a no-slip  solution  may  be  obtained  by  setting 
the  support  and  swing  leg  tip  accelerations  to  zero 


+ JLM-'[C2T  + J/Xf-H-G]  + j^q  . 

Combining  equations  (B.23)  and  (B.24)  into  a single  matrix  equation  yields 


p,=0  = C/M-'C,F,+C."M-VFr 


+ C,'"M-'[C2X  + J/Xf-H-G]  , 


(B.23) 


0 = AFr-B 


(B.25) 


where 


(B.26) 


C,"M  C,  C.'M-'jJ 
L J.M-’C,  JlM-'J  J 


(B.27) 


C/M-'fH  + G-C^x-j/Xf] 
J^M  ' [H  + G - C^x  - J/Xf  ] - j 


(B.28) 


Solving  for  the  support  and  swing  leg  ground  reaction  forces  yields 
F,=A  B 


(B.29) 
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B.2.2  Double  Support ; Slip  (Base) 

When  the  tangential  force  exceeds  the  friction  force  a slipping  solution  is 
required.  As  in  the  single  support  case,  the  support  leg  tangential  force  will  be 
related  to  the  normal  force  by  the  coefficient  of  friction  and  the  sign  of  the  leg  tip 
velocity  along  the  surface 

F»=R.C,A..  (B.30) 

P..=C4R.  'p.  • (B-31) 

Substituting  and  setting  the  support  leg  tip  normal  acceleration  and  swing  leg  tip 
acceleration  to  zero  we  obtain 


K = 0=C,R,-'C."M-'C,R,C3,F,^  +c,r,-‘c,'m-'j,'f, 


T, 


+ C4Rb‘'C,''M-‘[C2T  + j/tf-H-G]  , 

p,  =0= j,m-'c,r,C3,f,^  + j,m-'jJf, 

+ J^M  '[CjX  + J^  Xf— H — GJ  + j^q  . 

Combining  the  above  equations  into  a single  matrix  equation  yields 
0 = AF^^-B  , 

where 

Fr  = C3F„  , 


(B.32) 


(B.33) 


(B.34) 

(B.35) 

(B.36) 


C3  = 


^bF^3b  ^2x2 

^2x1  ^2x2 


(B.37) 
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A = 


C,R,-'C,"M-'C,R,C3, 
J,M  C,R,C3, 


b 'C/M  'Jj 


C.R.  C ' 
J,M  J, 


C4R,  C/M  ' [H  + G - C,x  - j/tf  ] 
J^M  [H  + G-C^t-j/xJ-jLq 


(B.38) 


(B.39) 


Solving  for  the  support  and  swing  leg  ground  reaction  forces  yields 


Fr  = C5A  'B 


(B.40) 


B.2.3  Double  Support : Slip  (Free) 

In  this  case  the  swing  leg  tangential  force  will  be  related  to  the  normal 
force  by  the  coefficient  of  friction  and  the  sign  of  the  leg  tip  velocity  along  the 
surface 


F =R  C F 

if  iXfV^3fif^  , 

Pf„  ~ C4Rf  Pf  , 

where 


Similarly 

p,  = 0 = C,'^M-'C,F,  + C,"M-' J jRf  C3f  Ff^ 

+ C/M-'  [C^x  + J^'^Xf  - H - G]  , 

Pf„  =0  = C4Rf  'J.M  'C.F,  + C4Rf-’j,M  'J jRfC3fFf^ 

+ C4Rf  'JlM-‘[C2X  + J/Xf  -H-GJ  + C^Rf  ji^q  . 


(B.41) 

(B.42) 


(B.43) 


(B.44) 


(B.45) 


Combining  the  above  equations  into  a single  matrix  equation  yields 
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0 = AFr^  -B  , 


where 


(B.46) 


(B.47) 


F = C F 

‘ R R, 


(BAS) 


■■2x2 


0 


2x1 


0 


2x2 


RrC. 


(B.49) 


C,^M  C,  C,^M  J jRfC3f 

C^Rf  ‘J^M  C,  C^Rf  Jj^M  'J jRfCjJ  ’ 

C,'"M-'[H  + G-C2T-J/tJ 
C^Rf-' J^M  ' [H  + G - C^x - J/Xf ] - C^Rf  ' j^q 


(B.50) 


(B.51) 


Solving  for  the  support  and  swing  leg  ground  reaction  forces  yields 


:QA- 


B 


(B.52) 


B.2.4  Double  Support : Slip  (Both) 

In  this  case  the  swing  and  support  leg  tangential  forces  will  be  related  to 
their  respective  normal  forces  by  the  coefficient  of  friction  and  the  sign  of  the  leg 
tip  velocities  along  the  surface 


F =R  C F 

(B.53) 

Pb„  ~ ^4^b  Pb  > 

(B.54) 

Ff  = RfCjfFf^  , 

(B.55) 

Pf  = C4Rf  Pf  . 

(B.56) 

Similarly 
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Pb„  = o = c,r,-'c,"m'c,r,C3,f,^ 

+ C,R,-'C,''M-'[C,t  + J/x,-H-G1  , 

= 0 = C,R,  'J,M  C,R,C3,F,^  +C,R,  'J,M  'jJR,C3,F, 

+ C4Rf  'J^M  ‘[C^x  + J/Xf  -H-G]  + C,Rf  jj^q  . 
Combining  the  above  equations  into  a single  matrix  equation  yields 
0 = AF„  - B . 

*'bf 


Where 


^Rh,  ~[^b  ’f’f  ] > 


F =C  F 


C7 


RbC3b 

. ®2xl 


^2x1 

R,C3, 


C,R,  'C,"M  'C,R,C3,  C,R,  'C,'M  'J,'R,C3, 


-1^  Tiv  ,-l  , T, 


L C,R,  J,M  C,R,C3,  C,R,-'JlM-'J,'R,C3, 


r-l¥  T, 


B = 


C4R, -'C,^M  ‘ [H  + G - C^x  - * Xf  ] 


C^Rf  ' ' [H  + G - C^x - ■ Xf ] - C^Rf  ' j^q 


Solving  for  the  support  and  swing  leg  ground  reaction  forces  yields 


(B.57) 

(B.58) 

(B.59) 

(B.60) 

(B.61) 

(B.62) 

(B.63) 

(B.64) 


Fr  = C7A  ‘B  . 


(B.65) 


APPENDIX  C 

GROUND  REACTION  FORCES:  IMPACT 
Repeating  the  statement  of  linear  impulse  and  momentum 

M(q^-q-)  = C,F,+jjF,  , 
and  rearranging  yields 

Aq  = M-'[c,F,+jjFj. 


(C.1) 


(C.2) 


C.1  Single  Impact 

In  single  impact  mode  the  swing  (free)  leg  comes  into  contact  with  the 
ground  while  the  support  (base)  leg  leaves  the  ground.  The  single  impact  mode 
will  occur  as  the  biped  exchanges  support  during  steady  locomotion.  Since  the 
support  leg  is  leaving  the  ground  it’s  impulsive  ground  reaction  force  is  zero 
F^  = 0 . (C.3) 

The  impulse  and  momentum  expression  reduces  to 

Aq  = M-'jjFf  . (C.4) 

The  Jacobian  matrix  relates  the  change  in  swing  leg  tip  linear  velocity  to  the 
change  in  generalized  velocities.  After  substitution  we  have 

Apf  =JLAq  = J,M-'jjFf  . (C.5) 

Therefore,  the  impulsive  force  vector  is  expressed  in  terms  of  the  change  in 
swing  leg  tip  linear  velocity 
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Ff  = DApf  , (C.6) 

where 

D = [JlM-'jJ]-'  . (C.7) 

Back  substitution  into  equation  (C.4)  yields 

Aq  = M-' J jDApf  . (C.8) 

Since  Ap  is  most  naturally  derived  in  surface  coordinates  (normal  & tangential), 
a general  solution  requires  a transformation  between  reference  coordinates  (z,x) 
and  surface  coordinates  (n,t)  as  follows: 


z 

n 

X 

t 

where 


Rf 


Cos(<|)f)  Sin(<t)f) 
-Sin((t)f)  Cos((l)f) 


(C.10) 


and  q,  represents  the  surface  slope  at  the  point  of  swing  leg  impact. 


C.1.1  Single  Impact : No  Slip 

Assuming  sufficient  friction,  a no-slip  solution  may  be  obtained  by  setting 
the  post-impact  swing  leg  tip  tangential  velocity  to  zero 

p;,=0.  (C.11) 

Using  the  definition  of  the  coefficient  of  restitution  (equation  3.15)  the  change  in 
swing  leg  tip  linear  velocity  becomes 
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(C.12) 


-Pf. 


Therefore 


(C.13) 


C.1.2  Single  Impact : Slip 

When  the  tangential  reaction  force  exceeds  the  friction  force  a slipping 
solution  is  required.  Post-impact  velocity  of  the  swing  leg  tip  normal  to  the 
surface  remains  known,  but  post-impact  velocity  along  the  surface  (tangential)  is 
unknown.  The  tangential  force  will  be  related  to  the  normal  force  by  the 
coefficient  of  friction  and  the  sign  of  the  swing  leg  tip  velocity  along  the  surface 


(C.14) 


(C.15) 


where 


(C.16) 


sgnfcb,  ) [i-f 


After  substitution  into  equation  (C.6)  we  obtain 


(C.17) 


(C.18) 


where 
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L = Rf  DRf  . 


(C.19) 


Equations  (C.17)  and  (C.18)  represent  two  equations  in  two  unknowns 
(Ff  ,Apf_ ) . After  substitution  and  separation 

Ff^  =L,|(-p“J(e  + l)  + L|2(Apf  ) , (C.20) 

Ff^Pf  =-Pf^(e  + l)L2i  + Apf  L22  . (C.21) 

Eliminating  Fj 

~ Pfi,  I +Apf  PfL|2  — ~Pf^  (e  + 1)L2i  +Apj^L22  > (C.22) 


and  solving 


APf.  =-Pf^(e  + l) 


^21  PL), 
PfLj2  — L22 


Substitution  yields 


Aq  = M' 


-Pf„(e  + 1) 
APf. 


(C.23) 


(C.24) 


C.2  Double  Impact 

In  double  impact  mode  the  swing  (free)  leg  comes  into  contact  with  the 
ground  while  the  support  (base)  leg  remains  in  contact  with  the  ground.  Since 
the  support  leg  does  not  immediately  leave  the  ground  it’s  impulsive  ground 
reaction  force  is  non-zero 

F,;^0.  (C.25) 

Re-writing  the  statement  of  linear  impulse  and  momentum  gives 
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Aq  = M'  ‘EFr  , (C.26) 

where 

E = [C,  Jjl,  (C-27) 

F.  = k F,]-  (C-28) 

Since  the  support  leg  tip  position  is  included  in  the  equations  of  motion  as 
generalized  coordinates  it  can  be  extracted  as  follows 

P.=C/q.  (C.29) 


The  change  in  leg  tip  velocities  in  terms  of  the  change  in  generalized  velocities  is 


Apb  = Cj'^Aq  , (C.30) 

Apf=JLAq  . (C.31) 

Combining  (C.30)  and  (C.31)  into  a single  equation 

Ap  = [Apb  ApJ  , (C.32) 

and  substituting  equation  (C.27)  yields 

Ap  = E’^Aq  . (C.33) 

Substituting  equation  (C.26)  into  the  above  equation  we  obtain 

Ap  = E^M-‘EFr  . (C.34) 

Solving  for  the  impulsive  forces 

Fr  = KAp  , (C.35) 

where 


K = [e^M-'e]"'  . 


(C.36) 


From  equation  (C.26)  and  (C.35) 
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Aq-M  'EKAp  . (C.37) 

As  before,  a general  solution  requires  a transformation  between  reference 
coordinates  (z,x)  and  surface  coordinates  (n,t)  as  follows: 


0 0 

Rb 

Xb 

= R 

tb 

, R = 

0 0 

Zf 

0 0 

Rf 

. - 

0 0 

where 


Rb  = 

‘ Cos((|)J 

Sin((^J 

, Rf  — 

Cos((j)f ) 

SinCbf) 

_-Sin((|)b) 

Cos(4>J_ 

^ I 

_-Sin((t)f) 

Cos(4)f ) 

(C.38) 


(C.39) 


and  (t)f  represent  the  surface  slopes  at  the  points  of  support  and  swing  leg 
contact  respectively. 


C.2.1  Double  Impact : No  Slip 

Assuming  sufficient  friction  a no-slip  solution  may  be  obtained  by  setting 
the  post-impact  base  and  swing  leg  tip  tangential  velocities  to  zero 

p:=0.  (C.40) 


Using  the  definition  of  the  coefficient  of  restitution  (15)  the  change  in  support  and 
swing  leg  tip  linear  velocities  becomes 


Ap  = r|p^-P  ]=r 


Pk  + 

-Pb. 

-p7__(e-i-l) 

-Pf. 


(C.41) 


and  substitution  yields 


148 


Aq 


M EKR 


■Pb„(e  + 1) 

-Pb. 

-Pf„(e  + 1) 

-P^ 


(C.42) 


C.2.2  Double  Impact : Slip  (Base) 

When  the  tangential  reaction  force  exceeds  the  friction  force  a slipping 
solution  is  required.  The  support  leg  tip  post-impact  tangential  velocity  will  be 
non-zero.  The  swing  leg  tip  post-impact  tangential  velocity  will  be  zero. 

K.  ^0  , (C.43) 

t>l=0.  (C.44) 

As  in  the  single  impact  case,  The  tangential  force  will  be  related  to  the  normal 
force  by  the  coefficient  of  friction  and  the  sign  of  the  support  leg  tip  velocity  along 
the  surface 


Ap  = R 


-P^(e  + 1) 
APb. 

-p'(e  + l) 


(C.45) 


(C.46) 


Substituting  into  equation  (C.37),  eliminating  and  solving  yields 


+ -PbN„) 
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Pf^(G  + l)(N23  M-b^l3-^  Pf,  (^24 


where 


N = R 'KR  . 


After  substitution 


Aq  = M EKR 


-Pb„(e  + 1) 

^Pb. 

-Pf/e  + 1) 


(C.47) 


(C.48) 


(C.49) 


C.2.3  Double  Impact : Slip  (Free) 

In  this  case,  the  support  leg  tip  post-impact  tangential  velocity  will  be  zero. 
The  swing  leg  tip  post-impact  tangential  velocity  will  be  non-zero. 


Pi,  = 0 , (C.50) 

p’^O.  (C.51) 


The  resulting  and  Ap  expressions  are 


Ap  = R 


•Pb„(e  + 1) 
-P^ 

-Pf^(e  + 1) 

^Pf. 


Fr=R 


b, 


K 

PfFf„ 


(C.52) 


(C.53) 


Substituting  into  equation  (C.37),  eliminating  and  solving  yields 


150 


^Pf.  = 


-f  p-  (e  + lKN^,  -|ifN3,) 


■ PfN34-N44 

~ Pb,  (^42  ~Pf  N32  ) ~ Pf„  1)(N43  — Pf  N33  ) j 


After  substitution 


Aq  = M 'EKR 


-Pb„(e  + 1) 
-Pb. 

-p' (e  + 1) 
^Pf. 


(C.54) 


(C.55) 


C.2.4  Double  Impact : Slip  (Both) 

In  this  case,  both  swing  and  support  leg  tip  post-impact  tangential  velocity 
will  be  non-zero 


K,  ^0  . 

Pf.  ^0  • 

The  resulting  F„  and  Ap  expressions  are 


Ap  = R 


Fr=R 


Pb„(e  + 1) 

^Pb. 

-p”  (e  + 1) 
'^Pf. 


*^b„ 

PbFb„ 

K 

PfF, 


(C.56) 

(C.57) 


(C.58) 


(C.59) 


Substituting  into  equation  (C.37)  and  eliminating  F„  yields  the  following  matrix 


equation 
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where 

(M-b^l2~^22)  (M^b^l4~^24) 

4ifN34-N^)J’ 

g _ l^t^b  (^b„^ll  ^'Pf„^13)~  (^b„^2l  “*“Pf„^23l 
(G  + l)|pf  (^b„^31  Pf„^33  )~  (Pb„  ^41  “*"Pf„^43) 


(C.60) 


(C.61) 


(C.62) 


After  substitution 


Aq 


-Pb„(e  + 1) 


M'EKR 


^Pb. 

-p“__(e  + l) 

^Pf. 


(C.63) 


APPENDIX  D 

GAIT  SYNTHESIS  FOR  THE  PLANAR  FIVE-LINK  BIPED 
Much  of  the  gait  synthesis  algorithm  is  locomotion  phase  dependent.  In 
the  single  support  (progression)  phase  the  desired  joint  trajectories  are  chosen 
to  satisfy  the  following  gait  parameters  which  are  fully  described  in  the  main  text 
(Section  4.1.1):  Vp,  Kb,  Pa,  Sli , SIf,  Shj,  Shf,  Shm,  Hf,  Tpc,  Kpc,  and  Ppc.  In  the 
double  support  (standing)  phase  the  desired  joint  trajectories  are  chosen  to 
satisfy  the  gait  parameters:  Vp,  Kb,  Pa,  Hf,  and  Fr.  This  appendix  is  separated 
into  single  and  double  support  sections.  Throughout  this  appendix  the  following 
shorthand  notation  is  utilized:  S0  = Sin(0),  C0  = Cos(0) . 

D.1  Single  Support  (Progression) 

Several  of  the  gait  parameters  are  used  to  describe  mid-step  variation 
about  a commanded  set  point.  The  knee,  posture,  and  tip  phase  coefficients 
(Kpc,  Ppc,  and  Tpc  respectively)  will  determine  mid-step  variations  in  knee  bias, 
posture  angle,  and  hip  bias  (AKb,  APa,  andAHb  respectively)  according  to  the 


following  equations: 

Ax  = c,  -Ccj)  , 

(D.la) 

Ax  = -c,  -q-Scl)  , 

(D.lb) 

Ax  = -c,  • [(j)^  ■ Ccj)  -F  ^ ■ S(j)] , 

(D.lc) 
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where  c,  represents  the  phase  coefficients  (Kpc,  Ppc,  Tpc)  and  Ax  represents 
the  mid-step  variations  (AKb,  APa,  AHb).  The  function  p will  be  known  as  the 
step  phase  angle  and  subsequently  defined  such  that  p = - ti/2  at  the  beginning 
of  the  step  and  p = ti/2  at  the  end  of  the  step.  This  cosine  term  is  used  because 
we  require  the  set-point  variations  to  be  zero  at  the  beginning  and  ending  of 
each  step. 

The  input  stance  knee  bias  (Kb)  and  knee  phase  coefficient  (Kpc)  are 
used  to  define  the  generalized  coordinate  0^ . Since  knee  bias  is  intended  to 
remain  constant  throughout  the  gait  cycle,  a natural  approach  would  be  to  define 
the  04  trajectory  as  follows:  04  = Kb  -i-  AKb,  ©4  = AKb,  §4  = AKb . This  approach 
will  work  as  intended  only  when  the  gait  parameters  are  chosen  such  that  the 
stance  swing  leg  knee  angle  is  naturally  identical  to  the  stance  knee  bias  at 
impact/switching.  This  special  case  will  rarely  if  ever  occur.  The  gait  parameter 
selection  will  most  often  result  in  knee  bias  asymmetry  between  support  and 
swing  legs  at  the  end  of  the  step.  If  this  asymmetry  is  large,  the  previous 
trajectory  definition  may  result  in  significant  trajectory  error  at  the  beginning  of 
each  step  cycle.  It  is  undesirable  to  feed  such  discontinuities  downstream  to  the 
tracking  control  since  the  tracking  errors  will  propagate  through  the  remainder  of 
the  chain.  To  prevent  this  we  need  a trajectory  that  will  eliminate  the  position 
error  while  maintaining  smooth  and  continuous  first  and  second  derivatives.  The 
difficulty  is  that  the  initial  velocity  and  acceleration  may  be  non-zero.  Igarashi  and 
Nogai  [55]  developed  an  ‘elementary  trajectory’  which  accounts  for  non-zero 
initial  conditions,  provides  smooth  derivatives,  and  eliminates  the  position  error 
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over  any  desired  settling  timely . The  following  function  is  adopted  from  their 
work.  The  desired  0^  trajectory  is  defined  as 

04  = +(Kb-e4,„Ji-e-»‘-«’-’'j+AKb  , 

e,  = (3at^  + 2|3t + rXKb  - e,  y + Akb  , 

04  = f 9ah^  - 1 2a(3t'  - (4(3'  + 6ay)t'  - (4(3y  - 6a)t  , 

+ 2P-y'lKb-e.l  J-"’-'-’-'  +Akb  , 


where 


a = 


ln(l.- 0.999) 


(D.2a) 

(D.2b) 


(D.2c) 


(D.3) 


Y = . 


04 

switch 

(Kb- 

04I  ) 

'+1  switch  ' 

1 

04 

switch 

2 

(Kb- 

1 switch 

-Y 


(D.4) 


(D.5) 


Progression  velocity  (Vp)  defines  the  desired  horizontal  velocity  of  the  hip 

joint 

Vp  = X,  . (D.6) 

Hip  joint  position,  velocity  and  acceleration  are  defined  relative  to  the  support  leg 
tip  in  joint  coordinates  as  follows 

X,  =L3S03+L4S(03-04)  , (D.7a) 

X,  =L3C03(03)  + L4C(03-04)(03-04)  , 


(D.7b) 
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X,=L3[C03(03)-S03(03)'] 


+ LJC(03  -0J(03  -0,)-S(03  -04)(0,  -0J-1  , 


(D.7C) 


Zh  - LjC03  + L^C(03  - 0^)  , 

Z,  =-L3S03(03)-L,S(03-0J(03-0J  , 

Z,  =-L3[S03(03)  + C03(03)^] 

-LJS(03  -0J(03  -0J  + C(03  -0J(03  -0,)']  . 

Substitution  of  (D.6)  into  (D.7b)  and  solving  for  0,  yields 

e,=^, 

V 

■■  vu-(Vp  + u)v 

03  = |03dt  , 

where 


u = L4C(03-0J04  , 


ii  = LJC(03-0J04-S(03 -04X0304 -04^)  . 
V = L3C03+L4C(03  -04)  , 


V = -L3S03(03)-L4S(03  -04X03  -e4)  • 


(D.8a) 

(D.8b) 


(D.8c) 


(D.9a) 


(D.9b) 


(D.9c) 


(D.10) 

(D.11) 

(D.12) 

(D.13) 


Posture  angle  (Pa)  and  the  posture  phase  coefficient  (Ppc)  are  used  in 
conjunction  with  the  previously  obtained  support  leg  coordinates  to  define  the 


156 


generalized  coordinate  0, . Posture  angle  along  with  its  mid-step  variation  are 


defined  as 

Pa  + APa  = 03-04-05  . (D.14) 

Solving  for  0,  yields 

05  =03-0, -Pa-APa  , (D.15a) 

05  =03  -0, -APa  , (D.15b) 

05  = 03  -0, -APa  . (D.15c) 


In  the  single  support  (progression)  phase  various  locomotion  tasks  can  be 
generated  by  specification  of  the  trajectory  of  the  swing  limb  tip(Xf,Zf).  Where 
Xf  and  Zf  are  also  defined  relative  to  the  support  leg  tip.  The  simplest  form  of 
the  relationship  between  swing  leg  tip  coordinates  that  allows  independent 
selection  of  step  length  and  step  height  is  quadratic. 


Zf  =aXf^  +bXf  +c  , 

(D.16a) 

Zf  =2aX|.X(.  +bX(.  , 

(D.16b) 

Z,  =2a(XfXf  +Xf')-rbXf  . 

(D.16C) 

Any  known  walking  surface  (flat,  inclined,  stairs,  rough)  may  be  negotiated 
by  appropriate  selection  of  these  coefficients  (a,b,c ).  Moreover  these 
coefficients  may  be  formulated  to  accommodate  arbitrary  initial  and  arbitrary  final 
leg  tip  separation.  This  formulation  allows  starting  and  stopping  gaits  to  be 
smoothly  integrated  with  the  normal  progression  gait.  The  input  gait  parameters 
Shi  and  Shf  are  the  values  of  Z,  at  the  beginning  and  end  of  the  step 
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respectively.  Similarly,  Sli  and  SIf  are  the  values  of  at  the  beginning  and  end 
of  the  step  respectively.  Shm  defines  the  values  of  Zf  when  is  midway 
between  SI|  and  SIf.  Figure  D.1  shows  a graphical  representation  of  the  gait 
parameters  which  dictate  swing  leg  tip  trajectory.  The  most  general  form  of  the 
quadratic  coefficients  is  thus  determined  to  be: 


2(Sh,+Sh,)-4Sh„ 

(D.1 7a) 

(SI,-SlJ 

(Sh,-Sh,)-a[(SI,)"-(SI,7] 

(D.1 7b) 

(S1,-S1,) 

Sh„-la(SI,+SlJ-ib(Sl,+Sl,). 

(D.17C) 

Zf 


Figure  D.1  - Swing  Leg  Tip  Trajectory 

What  remains  is  the  relationship  of  the  horizontal  component  of  the  swing 
leg  tip  Xf  with  respect  to  the  known  hip  position  X^ . The  following  equation 
defines  a relationship  that  nominally  positions  the  hip  midway  between  leg  tips 
but  allows  for  a constant  hip  bias  (Hb ) and  a mid-step  variation  on  hip  bias 
(AHb). 


Xf  =2[X,-(Hb  + AHb)]  , 


(D.1 8a) 


Xf  =2[x,-AHbJ, 

Xf  =2[x,  -AHb]  . 
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(D.18b) 


(D.18c) 


The  hip  bias  is  defined  in  terms  of  the  input  parameter  hip  fraction  (Hf).  Hip 
fraction  is  the  input  gait  parameter  describing  the  position  of  the  hip  joint  relative 
to  the  base  of  support.  The  use  of  Hf  in  the  above  equation  maintains  a 
consistent  definition  between  single  and  double  support  phases  since 


With  this  definition  of  hip  bias  (Hb)  and  step  length  (SI)  we  can  now  define  the 
phase  input  b used  in  our  mid-step  variation  equation  (D.1). 


This  definition  of  0 results  in  0 = - njl  at  the  beginning  of  the  step  and  0 = njl 
at  the  end  of  the  step. 

Once  the  spatial  trajectory  of  the  hip  and  swing  leg  tip  is  defined  it  is 
necessary  to  solve  the  inverse  kinematics  to  obtain  0^  and  0; . Figure  D.2 

depicts  the  kinematic  problem  at  hand.  From  the  figure  and  the  law  of  cosines 
we  obtain  the  following  relationships: 


Hb  = Sl(Hf-0.5) 


(D.19) 


where 


(D.20) 


^_(X,-Hb)7T 


(D.21a) 


SI 


(D.21b) 


(D.21C) 
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Figure  D.2  - Swing  Leg  Kinematics 


d = V(X,-X,)"+(Z,-Z,)’  , 

<i=7{x,-x,)(x,-x,)+(z,-z,)(z,-z,)}, 

cl 

d=l{x,-X,)(X,-Xf)  + (X,-X,)^ 

d 

(Z,-Z,)(Z,-Zf)+(Z,-Z,)^-d^}, 
L,^=L,^+d^-2dL,C(P)  , 


P = Cos 


,jL,^+d^-L/ 


2dL. 


p= 


dV(2dLj-(L.’+d^-L/|  ' 


duv-dd^(2u  + vw) 
du^ 


P = 


(D.22a) 

(D.22b) 

(D.22C) 

(D.23) 

(D.24a) 

(D.24b) 


(D.24C) 


where 


u = (2dLj'-(L,'+d'-L/)'  , 
v = (L/-d^-L/)  , 
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(D.25) 


w = 


+ d^ 


From  the  figure 


dC(o)  — (Z^  Zf)  , 


a = Cos  ' 


^ _ d(^h  ~^f  ~^f ) 

d^d^-{Z,-Z,f 

1 ••  • _1  • 1 
du’(dv-dv)-(dv-dv)(^du  ^li-du-) 
o = z ^ 

d'u 

where 

u = d'-v'  , 
u - 2dd  -2vv  , 


v = Z,-Zf  , 


V — Z^  Zf  . 


Similarly, 


d^=L,^+L/-2L,L7C(y)  , 


Y = Cos 


_,,L/+L/-d^ 


2L,L, 


(D.26) 

(D.27) 

(D.28) 

(D.29a) 

(D.29b) 

(D.29c) 


(D.30a) 

(D.30b) 

(D.31a) 

(D.31b) 

(D.32) 

(D.33a) 
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2dd 

V(2L,L,)'-(L,^  + L,^-d')'  ’ 

2u^  ( dd  + d" ) - ddu  ’ u 

) 

u 


where 


u = (2L,L,)^-(L/+L/-d^)^  , 


li  = 4dd(Lg^ -d^)  . 


Finally,  from  the  figure 


06  =7i-|3  + sgn(Xf -XJa-e  , 


06  =-p  + sgn(Xf -XJd-£  , 
06  =-p  + sgn(Xf -XJd-e  , 


where 


£ = 03  -04  -05  , 

£ = 03  -04  -05  , 
£ = 03  -04  -05  , 


and 


07  =7c-T  , 
07  = -Y  . 

07  = -y  . 


(D.33b) 

(D.33C) 


(D.34a) 

(D.34b) 

(D.35a) 

(D.35b) 

(D.35C) 

(D.36a) 

(D.36b) 

(D.36C) 

(D.37a) 

(D.37b) 

(D.37C) 
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D.2  Double  Support  (Standing) 

The  stance  knee  bias  in  double  support  mode  is  exactly  the  same  in 
single  support  mode.  The  desired  0^  trajectory  is  defined  by  equation  (D.1).  In 
double  support  mode  the  B,  trajectory  calculations  involve  both  the  progression 
velocity  Vp  and  the  hip  fraction  Hf . The  following  relation  defines  hip  fraction  as 
the  position  of  the  hip  joint  relative  to  the  base  of  support  independent  of  which 
foot  is  fonA^ard  (support  or  free) 


Hf  = 


>0 

X, 

0,Xf  =0 


(D.38) 


1-^ 

Xf 


Xf  <0 


Under  this  definition  the  progression  velocity  Vp  = X^  is  used  in  double  support 
mode  to  rate  limit  the  commanded  hip  fraction 


Hf 


Xr 


(D.39) 


In  double  support  mode  the  swing  leg  tip  position  Xj  is  known.  Therefore,  the 
hip  position  is  obtained  as 


Xh 


X,Hf,Xf  >0 

0,Xf  =0 

Xf(l-Hf)Xf  <0 


(D.40) 


Once  the  spatial  trajectory  of  the  hip  is  defined  it  is  necessary  to  solve  the 
inverse  kinematics  to  obtain  0^ . Figure  D.3  depicts  the  kinematic  problem  at 

hand.  From  the  figure  and  the  law  of  cosines  we  obtain  the  following 
relationships: 
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Figure  D.3  - Support  Leg  Kinematics 


P = 71-04  , 

(D.41a) 

P = -04  , 

(D.41b) 

d = -jL3'+L/-2L3L4C(p)  , 

(D.42a) 

^ _ L3L4S(P)P 

(D.42b) 

VL3'  + L/-2L3L4C(P) 

sC(a)  = X,  , 

(D.43) 

a = Cos-'{^}  , 

(D.44a) 

^_ddX,-d^Vp 

(D.44b) 

- X,’ 

L4^=L3'+d'-2L3dC(Y)  . 

(D.45) 

(D.46a) 
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d(L/-d=-L,-) 


(D.46b) 


From  the  figure  63  is  then 


(D.47a) 


63  ==-a  + y . 


(D.47b) 


Posture  angle  and  the  inverse  kinematics  are  the  same  in  double  support  as  in 
single  support  except  now  the  swing  leg  tip  position  if  fixed  and  known. 

The  existence  of  the  support  leg  ankle  torque  makes  it  possible  to  vary 
the  distribution  of  the  ground  reaction  forces  without  changing  the  configuration 
of  the  biped.  Assuming  the  generalized  velocities  and  accelerations  are  zero  the 
nominal  reaction  force  distribution  is  such  that  the  moment  about  the  biped 
center  of  mass  is  zero  (see  Figure  D.4).  In  this  static  state  we  further  know  that 
the  sum  of  the  vertical  components  of  the  ground  reaction  forces  will  equal  the 
biped  mass  times  the  acceleration  due  to  gravity 


Fb  + Ff 


(D.48) 


Ffdf  =F^db  =(gM-Ff)db 


(D.49) 


cm 

S 


Figure  D.4  - Reaction  Force  Distribution 
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Therefore  the  nominal  (steady  state)  swing  leg  ground  reaction  force  in  double 
support  is 

P _ gMd,  (D.50) 

(df+dj  ■ 

The  force  ratio  is  merely  a scalar  multiplier  of  this  nominal  force 

F/=FrFf.  (D.51) 

Ff*is  the  desired  steady  state  swing  leg  ground  reaction  force  which  is  input  to 
the  control  algorithm. 


APPENDIX  E 

SLIDING  MODE  CONTROL  EQUATIONS 


Here  we  present  basic  equations  of  the  robust  control  technique  known  as 
sliding  mode  control.  The  sliding  mode  algorithm  is  derived  assuming  second 
order  system  equations  since  this  is  the  case  for  the  planar  five-link  biped  model. 
The  details  of  the  more  general  sliding  mode  control  technique  can  be  found  in 
Slotine  [56]. 

Consider  a dynamic  system  of  the  form 

q = a(q,q)  + b(q,q)u  , (E.1) 

where  u is  the  control  input,  a(q,q)  and  b(q,q)  are  non-linear  functions  which 


are  not  exactly  known  but  with  errors  (|a  -a| , b - b ) bounded  by  continuous 

functions  of  (q,q) . The  control  problem  at  hand  is  to  get  the  system  to  track  a 
specified  desired  state  trajectory  (qd.qd.Qd)- 


We  now  choose  a sliding  surface 
S(t):s(q,q)  = 0 , 


(E.2) 


to  be  a well  behaved  function  of  the  tracking  error.  One  possible  (not  unique) 
function  is  as  follows 


s(q,q)  = q + 2Xq-f-X^Jq(x)dT  = 0 . 


(E.3) 


If  we  assume  that  the  actual  and  desired  trajectories  are  aligned  at  time  zero, 
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ql,.„=0.  (E.4) 

The  tracking  control  problem  is  equivalent  to  remaining  on  the  surface  S(t)  for  all 
time  t > 0 . In  essence  by  this  clever  choice  of  the  sliding  surface  we  have 
transformed  the  second  order  tracking  problem  into  a first  order  stabilization 
problem. 

The  simplified  first  order  stabilization  problem  can  now  be  solved  by 
choosing  a control  law  u such  that  remains  a Lyapunov-like  function 
(Vidyasagar  [57])  of  the  closed-loop  system 

iis^(q>q)^-'n|s| > 'n>o  , (E.5) 

despite  the  presence  of  model  imprecision  and  disturbance.  Equation  (E.5), 
known  as  the  “sliding  condition”,  states  that  the  squared  distance  to  the  surface 
decreases  along  all  system  trajectories.  Once  on  the  surface  the  system 
trajectories  remain  on  the  surface. 

Satisfying  (E.5)  further  guarantees  that  if  (E.4)  is  not  initially  satisfied,  the 
surface  S(t)  will  nonetheless  be  reached  in  a finite  time  (reaching  phase) 

treach  ^|s(t  = 0)|/Tl  . (E.6) 

The  surface  definition  (E.3)  then  guarantees  that  once  the  surface  is  reached  the 
tracking  error  will  tend  exponentially  to  zero,  q ^ 0 as  t . 

The  controller  design  consists  of  two  steps.  First,  choose  a feedback 


control  law  u,  which  will  satisfy  the  sliding  condition  (E.5).  One  such  law  is 

u = u-K  sgn(s)  , (E.7) 
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where  u is  the  best  approximation  of  a continuous  control  law  which  makes 
s = 0,and  K sgn(s)  is  discontinuous  across  S(t) 


sgn(s)  = < 


+ l,s>0 
0 ,s  = 0 
- l,s<0 


(E.8) 


K is  chosen  to  satisfy  the  sliding  condition  and  accommodate  the  model 
imprecision  and  disturbance.  The  second  step  is  to  smooth  the  control  law  in  a 
boundary  close  to  the  sliding  surface.  This  is  required  since  the  discontinuous 
element  leads  to  undesirable  control  chatter.  The  selection  of  this  boundary 
thickness  will  be  shown  to  be  a trade-off  between  tracking  precision  and  control 
bandwidth. 

Assume  initially  that  b(q,q)  = 1 ; 

q = a(q)  + u . (E.9) 

The  approximate  model  is  then 

q =a-t-u  . (E-10) 

Differentiating  the  sliding  surface  (E.3)  and  substituting  the  approximate  system 
equation  (E.10)  yields 

s = (a -(- u - (jj) -I- 2X.q -I- X,^q  (E-11) 

The  best  approximation  of  a continuous  control  law  that  makes  s = 0 is  therefore 

u = -a  + q^ -2Xq-X.^q  . (E.12) 

The  magnitude  of  the  non-linear  term  is  then  chosen  to  satisfy  the  sliding 
condition  equation  (E.5).  Substituting  equations  (E.7),  (E.1 1),  and  (E.12)  into  the 
sliding  condition  yields 


169 


Tls“(q,q)  = s s = s[a-a-Ksgn(s)]  . 
Choosing 


(E.13) 


K = a - a + T]  , 


(E.14) 


we  obtain 

{|-s^(q,q)<-'n|s|  , (E.15) 

as  desired. 

We  may  now  generalize  to  the  case  where  b(q,q)  1 
q = a(q)  + bu  . (E.16) 

We  assume  that  b(q,q)  can  be  estimated  by 

b = Jb  b . (E.17) 

V max  min 


The  approximate  model  is  then 
q = a + bu  . 

We  define 


p b ^ 


P>1 , 


(E.18) 


(E.19) 


The  term  p can  be  thought  of  as  a kind  of  gain  margin.  The  control  law  then 
becomes 

u = b"'  [u  - K ■ sgn(s)]  . (E.20) 

Following  a similar  procedure,  the  gain  K which  will  satisfy  the  sliding  condition 
becomes 


K = P|a  - a|  + Pri  + (P  - l)|u| 


(E.21) 
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The  control  law  that  satisfies  the  sliding  condition  is  discontinuous  across 
the  surface  S(t).  In  practice  this  discontinuity  leads  to  extremely  high  control 
activity  and  chattering.  To  eliminate  this  undesirable  chattering,  the  control  signal 
is  smoothed  in  a thin  boundary  layer  around  the  sliding  surface 

B(t)  = {q,q),|s(q,q)|<o},  O>0  . (E-22) 


Here  O is  the  boundary  layer  thickness  and  e = 


O 


is  the  boundary  layer  width. 


Once  within  the  boundary  layer  we  have 
|S(t)|<0  for  all  t>0  , 

which  by  the  definition  of  the  sliding  surface,  implies 


q <e 


<2Ae 


(E.23) 


(E.24) 


O 

Therefore  the  tracking  accuracy  is  determined  by  8 = -^ 


The  new  smoothed  control  law  is  then 


u = b 


-1 


^ s ^ 

u - K(q,q)  sat 

_ 

(E.25) 


where 


sat(x) = 


I X ,|x|  < 1 
|sgn(x),|x|>  1 


(E.26) 


K(q,q)  = [K(q,q)  - K(qj,q,  )]+ 


(E.27) 


Recognizing  that  the  saturation  function  essentially  assigns  a low-pass  filter 
structure  to  the  dynamics,  we  can  choose  the  boundary  layer  thickness  to 
achieve  the  most  desirable  trade-off  between  tracking  error  and  robustness.  The 
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boundary  layer  may  be  made  time  varying  in  order  to  take  full  advantage  of  the 
knowledge  of  the  uncertainty.  The  dynamic  evolution  of  the  boundary  layer 
thickness  is  governed  by  the  following  dynamic  balance  conditions 


0 + >,0  = (3K(q^,qJ 

. K(q,,q,)>  — 

0 + X0/p^=K(q,,q,)/p 

, K(q,,q,)<  — 

The  dynamic  boundary  conditions  are  derived  from  the  sliding  condition  with  the 
additional  constraint  that  the  distance  to  the  boundary  layer  (rather  than  the 
surface)  must  always  decrease.  Initial  conditions  for  the  boundary  layer 
thickness  are 

cD(0)  = PK(q,(0),q,(0))/^  . (E.29) 

Finally  the  entire  solution  is  repeated  here  for  convenience.  The  equations 
appear  in  their  logical  order  of  execution. 


m = [m„...mJ, 

(E.30) 

m-'=m-'=l  = [l„...lJ, 

(E.31) 

(E.32) 

R,=(^r-^rY . 

(E.33) 

(E.34) 

s(q,q)  = q + 2A,q  + Jq(T)dt  , 

(E.35) 

K,(q,q)  = p,||L,nAh|  + X|qji|  L/M,  Rj+q,}  , 

(E.36) 
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0>i(0)  = (3iKi(qj(0),qj(0))/?ij  , 


O;  =PiKi(q^,qJ 


Ki(qd,qj^ 

Ki(q,,qd)< 


X,0., 

X" 

Pi 


Ki(q,q)  = [Ki(q,q)-Ki(qj,q,)]+^ 

u.  =q^.  -2Xjqi  -Xj^q,  , 


f s. 

U.  =R.(q) 

Uj  -K;(q,q)  sat 

1 

o. 

^ ■ yJ 

(E.37) 

(E.38) 

(E.39) 

(E.40) 

(E.41) 
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